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ABSTRACT 


This thesis presents a simulation study of the 
CP/67 time-sharing system. A brief survey is given 
of the development of computer software systems 
leading to the implementation of complex time-sharing 
systems such as CP/67. Time-sharing systems are 
discussed in terms of the problems they present in 
design and implementation, and the resulting need for 
evaluating their performance. Methods of evaluating 
system performance are presented, and a detailed 
description is given of a specific evaluation project, 
using simulation, which was undertaken by the author. 
Included is a description of the simulation model 
developed of CP/67, as well as a description of the 
Measurement technique used to obtain datasfrom the ineal 


system. 


Finally, the thesis presents the results obtained 
from the measurement data and from exercising the simu- 
lation model under various load conditions and with 


alternate values of several CP/67 parameters. 
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CHAPTER I 
INTRODUCTION 


With the advent of expensive large-scale computing 
systems, it becomes necessary to ask the question: is 
this particular computer system being used efficiently? 
In other words, is this computer system operating at 
Maximum capacity, and giving the best possible response? 
To ask this question is to immediately suggest another 
one: how does one determine whether a computer is being 
used efficiently? Because recent development of compu- 
ter hardware and software has been so rapid, the develop- 
ment of computer evaluation techniques has lagged far 
behind. The emergence of time-sharing system, in 
particular, has emphasized the need for better methods 
of system evaluation. In light of these developments, 
this thesis is primarily concerned with methods of 
measuring and evaluating the performance characteristics 
of computer operating systems, and how these methods can 


be used to improve the efficiency of computer systems. 


1] The Development of Computers 
1.1 Hardware Development | 
Until recently, the advancements of computer systems 


were generally described in terms of hardware development. 
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Computer hardware has progressed from the characteristic 
vacuum tubes of the first generation systems, to the 
transistor of the second generation, to the integrated 
Giyecuits OfFthe third **The major -effect® felt from this 
development was the greatly increased reliability of 


both logic and memory circuitries at a reduced cost [38]. 


1.2 Software Development 


It was from this hardware development that a second 
and, to,the, user, a more profound effect was felt; that 
of software development. As computers became more 
reliable and less expensive, there naturally followed 
a corresponding increase in the number and variety of 
demands for their use. It is software which allows for 
the wide variety of applications that computers are 
sed sroratoday. 

Software has progressed from a first generation 
characterized by machine language and assemblers, 
through a second generation of high-level language 
processors and system monitors, to the present genera- 
tion featuring complex operating systems. Whereas 
first generation computer systems were primarily used 
for computation, the development of software has made 
data management an equally important application for 


computers. To both these areas, the introduction of 
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user-computer communication has also been a valuable 
software contribution. 

The role of software in the operation of a 
computer system has reached a point where, today, the 
term "computer system" usually refers to the operating 
system, with little regard for the hardware of the 
system. Since this thesis is primarily concerned with 
the performance characteristics of current operating 
systems, it would be well to include here a short 
survey of the development of software operating systems. 
From this we can gain a better understanding of what is 


an "operating system" and what are its functions. 


Peel ee oat CheMOnLCOLS 


One of the limiting features of early computers 
was the amount of time necessary to set up a program for 
execution. As the number of users grew, the throughput 
of the computer became more dependent on the operators' 
abilities to manually load and unload programs. It 
appeared that many of the operator functions could be 
replaced by a program, and thus the development of 
operating systems was an obvious attempt to increase 
the Saietves: throughput. 


The early operating systems were quite simple 





since they were required to perform a well-defined set 
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of duties, usually in some well-defined, sequential 
order. They would read in a job, call in an assembler 
or compiler, load and execute the resulting object 
program, and, after execution, terminate the job, and 
begin the next. Although somewhat simplified, this 
description still applies to the batch operating 
system of today. 

Performance in these systems, in terms of through- 
put, was greatly improved over those using manual loading 
techniques. Throughput capability was dependent on such 
hardware factors as the CPU (central processing unit) 
cycle time, memory access time, card reader speed, and 
line printer speed. The performance of the software, 
because of its limited duties, was not a significant 


factor in the overall system performance. 


Pa ec Clanne ls sands Inbeerbupcs 


The straightforward, synchronous nature of opera- 
ting systems disappeared with further advances in hardware 
and software. In particular, the development of the data 
ehannel, with its ability, to interrupt the activity of 
the main processor, exerted the greatest influence on 
software development in this period [31]. 

The channel is essentially another computer, connec- 


ted to the main processor computer, that is designed with 
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only the limited capabilities of controlling the transfer 
of data between the I/0 (input/output) devices and main 
memory. The channel receives its instructions from the 
main processor but otherwise operates independently and 
concurrently with the main processor. In order to 
Maxsmuczer ene Ulltizations,o£r I/0° devices (and of main 
processor and memory), the channel must signal Be Sane 
pletion of an assigned task so that another task can be 
assigned to the channel. This is done by sending an 
interrupt to the main processor. Although the interrupt 
itself is a hardware feature, it is essentially a call 
BOedscOLtEWaLesrOutLInNe.) inis routine must first. record 
PnemouelusmOtethicaCirients JObuinsorder that processing 
may be resumed later. The routine then interprets the 
cause of the interrupt, and performs the appropriate 
action before restoring the interrupted program to running 
Std Uo. wer hesoccuLrence of other; ditrerent hardware inter— 
rupts, while the first is still being processed, must be 
allowed. 

As the software field gained in importance, other 
items besides hardware efficiency had to be considered 
in the definition of system performance. Particularly, 
as the number and complexity of the duties of software 
increased, the software efficiency became an important 


factor. For example, the more efficient the interrupt 
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routine was, the less time the main processor was 
required to wait for that I/0, and the more useful 


work it could accomplish. 


dreary 64 Multiprogramming 


The next important development in the design of 
operating systems was the implementation of multi- 
programming. Multiprogramming is the maintenance of 
more than one program in an active state at one time 
within a single system [31]. Being active means that 
whenever the first program enters a wait state, another 
program is immediately available for execution. Thus 
multiprogramming allows the computer to utilize the 
time that is normally lost waiting for 1/0 by executing 
another program. 

The responsibilities of the operating system 
expanded proportionally to the number of activities it 
had to coordinate. Maintaining a smooth flow of work 
through the computer required an increasing amount of 
system bookwork, keeping track of the current status of 
the programs sharing the computer and the computer 
resources for which the programs were competing. When 
there was more than one active program the resources, 
such as the CPU, main core storage, and secondary storage, 


had to be shared between the programs. If any of the 
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resources were not available when required by a program, 
that program must wait and another program must be 

found which could be executed with the currently avail- 
able’ resources. 

However, as well as improvements obtained from 
software developments, there were also considerations 
that reduced system performance. As their complexity 
increased, the operating systems used an increasing 
amount of processor time, overhead, and also precious 
Space in main memory. While the objectives of multi- 
programming were to increase utilization of computer 
resources, especially processor time and storage space, 
the demands of the operating system itself placed these 
objectives in serious jeopardy. 

However, at this point, system performance could 
still be fairly easily defined and measured in terms of 
system throughput. Reduced overhead was a _ possible 
area through which improved performance might be obtained, 


although its significance would probably be small. 


122.4. Time-Sharingy Systems 


The latest significant development in operating 
systems, which brings us to the area of concern in this 
thesis, came with the advent of the time-sharing computer 


system. A time-sharing system can be defined as a 
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multiprogramming system in which many jobs are active. 
It is furthermore assumed in this thesis that a time- 
sharing system implies quick-response , on-line job 
entry. That is, a time-sharing system is one which 

has the capability of receiving requests for execution 
directly from terminal users, and is designed to give 
immediate response to these requests. It is also 
assumed that a time-sharing system implies multi-access 
job entry; that is, the system can receive job entries 
from several terminals at the same time. 

ALEnOugG nD sbeautitulin wes concept ~.the result of 
enabling all users to be active and to “promise" them 
all dedicated service has had far reaching effects on 
the design of computer systems. The situation could 
arise that all users make a request at the same time, 
and there could be virtually unlimited demands for the 
resources of the computer system. How does the operating 
system hope to handle efficiently such a situation? 


Tus sromthe  COnGernyoOLn this thesis. 


The term"quick-response"is used as opposed to the 
term"real-time". Real-time is usually applied to 
a Situation where computation occurs at the same 
time as a related physical process, and where the 
results of the computation are used to guide this 
process. 
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2 Thesis Outline 


themes: chapter describes further the principles 
involved in the design and implementation of time-sharing 
systems. The concept of scheduling is introduced as the 
means of implementing a system designed to allocate a 
limited set of resources among an unlimited set of demands. 

Chapter III attempts to show how the need for per- 
formance evaluation arises out of the new complexities 
created by these systems, and yet how these complexities 
in turn make it difficult to define, as well as to measure, 
system performance. Possible methods of evaluating a 
time-sharing system are discussed, including methods of 
obtaining measurement data from a system. 

Chapters II and III are intended to be tutorial in 
nature. Those readers who are familiar with the principles 
of time-sharing systems might consider starting on Chapter 
LV 

Chapter IV describes a specific evaluation project 
undertaken by the author and compares it with previous 
projects of a related Pacure, fe well as describing the 
time-sharing system involved (CP/67 at the University of 
Alberta). 

Chapter V describes the technique used to obtain 
measurement data from the CP/67 system, as well as the 
simulation model developed. Chapter VI presents the 


results obtained from both the measurements and the model. 
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CRAP TERRES 
TIME-SHARING SYSTEMS 


"Time-sharing of computer facilities has been 
widely acclaimed as the most significant evolutionary 
step that has been taken in recent years toward the 
development of generalized information utilities" [32]. 
Sackman goes on to show that time-sharing systems were 
an outgrowth of early real-time systems developed in 
the 1950's for command and control systems, specifi- 
cally those connected with S.A.G.E. air defence [12]. 
Out of these systems grew the early time-sharing systems 
where many military operators at separate consols were 
able to simultaneously request and receive information 
from one central computing system. 

From this grew the present day concept of a time- 
sharing system which provides a complete general- 
purpose computer facility to many on-line users at 
the same time. The general-purpose systems are 
designed to give each user full access to the computer's 
Capabilities. The users of such a system can thus be 
conceived as a more or less random and changing collec- 
tion of people, each entering and leaving the system 


independently, each using it for varying periods of time, 
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and most important, each working on unrelated tasks 

[32]. The system is general-purpose in that there is 

no restriction on the kind of program it can accommodate. 
Although there are also time-sharing systems which are 
designed for specific applications, the term "time- 
sharing system" used herein will refer specifically 


to general-purpose time-sharing systems. 


tee neplestorson. fime-onaringesystems 


The best overall objective of a time-sharing 
system is "To provide the users with easier access to 
the computer, and to increase the interaction between 


the users and the computer". 


ineal Primary Objective - Services 


Instead of this objective another, more fanciful, 
Ob JeEctivemis Often sought — that of providing each user 
with the impression that he is receiving the full, 
dedicated attention of the computer. To create this 
illusion, it is necessary to provide guick response to 
all users. Thus immediate response to users' requests 
becomes the main objective in designing time-sharing 
systems. 

These systems, however, are designed primarily 


to handle conversational users requiring small amounts 
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of computing time. If several users simultaneously 
request .a large amount of computation, it will .put 

a high demand on the computer resources and quick 
response Cannot be achieved. Thus the primary objec- 
tive becomes one of providing the best possible response 
to all types of users, with first consideration being 
given to conversational users, and hoping that most 
users will limit the number of programs requiring large 


amounts of computing time. 


Peeve cOndatysOOjeCEIVe. ~ .Uel lization 


A secondary objective of time-sharing systems, 
like that of any multiprogramming system, is to obtain 
better utilization of the various system resources. 
(Multiprogramming and its objectives were introduced 
gpeChapLrer I.) Li SeClComliauEche successful attain— 
ment of this secondary objective almost always 
influences the successful attainment of the primary 
One ewe Lie elrectiveness-Of these systems ani providing 
fast service depends in large part on the efficiency with 
which the resources of the computer are allocated to the 


individual, users.) 5.]s. 


1.2.1 limewand-space Management 


The secondary objective depends on two major 


factors - time and space management. Time management 














‘ a 
\ ' ‘ be 
, j Hc) T er ks Z aii te tOvVeara tA « CMALS ,. ly 4 biyi yeas: /~ 


“e ok  eotdedaquvies %4 ayes stot G ee 
Rida) hs jae | mt bladie ay tebe" Bs 

iV 7 : di 7 j E 4 7 i.) +< uqaas. - 

: : - Tre ¢ 


Tea! F io Sti pmoved aves 
[sty .@Yse 26 eoqgd> See 
yer : neon Ceae@icentevias OF aie 


4 oe 20" Ai. Ss “Ti Liiw Sia ls 
_ oe | 


: 
y { WIG Sw 
“aq Pte ) d a 
. : ; he 
hi 4 irs % =~ Ds tant } ange 
‘av, 4s ; iia ace lity added 
Wee 5 ; ~ f rie i ? fie Ped Lc] , 4 Cum) 
j i va 4 an Lu J ‘cit [sh ert 
. i) 
vi ; cnht: i s' b HT 4 Fido Wine «wz Sits i irient 
§ | - ; . 
: j S 290 Via eo a weezer 1 
sO 
pits rari ij ji Pes hee ‘cai? 28 PesnaviSosetts ser es 
i ; ' ‘ : ’ a 


_ Melt LoLI te ony mm dteq apasl, tk atoonsb oh ieeae Feed 
en 


eles peta Pie aif toqinad ai to 2a ceiensigey aig fain 
ate. en Sabri 


pests, 










=) 7 4 
(a ok 


oe 








es 


af 


§3 


means the assignment of computing, or CPU, time to the 
users. A time-sharing system has many users, all of 
which may be making a request for processor time at 
once and all of which are expecting immediate response. 
These requests must be handled efficiently, not only 
to achieve quick response, but also to minimize the 
overhead which could significantly reduce the total 
CPU time~availlable for users. 

Space management involves the storage of users' 
programs and data during execution as well as "overnight". 
When several users request execution of a program simul- 
taneously it is physically impossible to keep all active 
programs in core at the same time. The high cost of 
core storage prohibits the provision of unlimited main 
core memories. This requires the provision of less 
expensive, and slower, secondary storage devices in 
which to store information not in immediate use. 

Because of the remote access implied by time-sharing 
systems, it is also essential that some area of 
secondary storage be provided for the user to file 
away his programs and data overnight, where he has 
easy access the next time he needs them. 

The operating system becomes responsible for 
HWOvVinG al LeIncOrmatrton aicOsanadrout OL -COLre and for 


keeping track of the whereabouts of all information 
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as it is being moved around. Again the speed and 
efficiency with which the system carries out its 
space management is a Significant factor in the smooth 


functioning of the system. 


Zee Uhes imp lementablon on lime-Sharing Systems 


Although a computer often seems to do many things 
Simultaneously in the human time scale, it does in fact 
handle all requests sequentially, and it is the purpose 
of the operating system to schedule the use of the 
computer's resources between the current requests. 
Procedurally, then, time-sharing systems are based 
around queues of demands for system resources. If a 
particular resource is not available, a demand for that 
resource must wait in queue until it becomes available. 
"Scheduling is the process of allocating resources to 
workload to satisfy some objective of good service" 
Po) wee iteiSein the area.of scheduling theory that the 


actual implementation of time-sharing systems is based. 


2.1 Scheduling Demands for Time 


The distinguishing feature of a time-sharing 
system, and the one after which it is named, is the 
concept of time-slicing. An ordinary multiprogramming 


system will normally run a program to completion, whereas 
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the time-sharing system will only give that program 
one time-slice in which to execute. At the end of 
that time-slice, which is some small time increment, 
say 50 milliseconds, a timer-controlled interrupt 
occurs, the program is automatically terminated, and 
another is started. Sihéyterminated program must wait 
for another time-slice to resume execution. 

The theory behind time-slicing is that it allows 
shorter jobs to be completed more quickly by preventing 
long jobs from dominating the system. In essence it 
gives high priority to short requests, which is in 
accordance with the objectives of time-sharing. 

Important consequences are implied by the occur- 
rence of these timer interrupts. Each such interrupt 
means the system must look for another job to execute, 
and it is in this decision-making process that the 
influence of the operating system becomes evident in 
the overall operation and performance of the system. 
Various schemes, better known as job scheduling algorithms, 
have been developed to make this decision of which job 
should execute next in order to best meet the objectives 
of a time-sharing system. 

The role of these algorithms is shown schemati- 
Callyein Figs 2.) mel lney basically involve ordering the 


users who are currently requesting processor time and 
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and placing them in a queue. The next user to execute 


is selected from the front of the queue. It has been stown [35] 


Service 
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PaQeee2. te ochedulings Algorithms 


eiotetoewODe Mata ciOolcerOreamext user is the one with 

the shortest remaining processing time. However this 
requires prior knowledge of the size of the request, which 
the operating system does not have. We shall next discuss 
some of the techniques which have been developed in an 


attempt to overcome, or at least minimize, this handicap. 


2:1.1- Round-Robin Algorithms 


The round-robin scheduler is shown schematically 
tmPig. 2.2. wWobssare taken from thes front of fine queue 
and provided with a time-slice of service. if the job 
chosen completes execution within the time interval 


allocated, then it is simply ejected from the system 
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(i.e. the results are sent back to the user at the 
terminal). If, on the other hand, the chosen job 
requires more time than allocated, it is removed from 
execution and put at the back of the queue. After all 
jobs ahead of it have also received their time-slice 

of service, it is again given another time-slice, and 
execution is started at the point where it was previously 
interrupted. 

The decision-making process is quite simple in 
thasecase. ~Farst.choice;goes,to,the job, which. has 
waited the longest in queue (first-come, first-served). 
The fault of this algorithm is that large jobs which 
have been in the system for a long time are getting the 


same priority as those which have just entered and which 


may be quite short. 
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2.1.2 Foreground-Background Algorithms 


There are a multitude of scheduling schemes which 
fall under the heading of foreground-background algori- 
thms. The basic implementation is shown schematically 
pehlg. 2.0.) ALL jobs: walting to be executed are 
assigned a priority based on information taken from the 
previous execution of that job. New arrivals are given 
top priority by being placed in the foreground queue. 
if, atter one complete time-slice, they have not completed 
execution, they are put in the lower priority background 
GHUsicCeeWHehe aytews/Obsis srequired For execution, anes, 
BOLeCrOund Queue is searched first. | Llt there are no 
jobs on the foreground queue, then the first job on the 
background queue is given another time-slice. Within 


each gueue, selection is first-come, first-served. 
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Fig. 2.3 Foreground-Background Algorithm 
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However there is a lot of variation from the 
basic algorithm. Instead of one background queue, 
there can be several. After a complete time-slice 
in one background queue, the job can be put at the 
back of the next, which is of lower priority. On 
the other hand, a job can be allowed to remain in a 
particular queue for more than one time-slice. Of 
the many possible variations, the job scheduler of 
CP/67 is an example which will be described in more 


detail in Chapter IV. 


2.2 Scheduling Demands for Space 


The problem of space management was introduced 
tn ceCtLonelec. 1). It’ was pointed out that the fora 
core storage required when several jobs run concurrently 
will generally exceed the actual physical capacity of 
the high speed core storage. Swapping and paging are 
two common methods used to handle this problem of space 
management. 

Swapping was the first method used by early time- 
sharing systems [34,13, 7]. When a program was chosen 
to run, the entire program and all its data was brought 
into core. When execution halted the program was 
restored (swapped) back onto secondary storage anda 


new program was brought in for execution. Since the 


wt aclipinsy *o Sof A ek oxrpd? averse 










toed 


x af. tloatw 1 of fog 


Fe Le | = Ps tA oto are. : 


hers Ui 


oy an nede aa tik. sabptn slyo tage a 
| ; On Orakee 
r te } na ING 
i { [ Lsjeae 
- ; fon Se “ 
~~ ath al \ = z 
| . et  ) 
: I 4 i r sf 4908 at 
' iL 


iis a a ; may i 4 oy Pag iad eghe i y 
a a. Gal 1 : YQ] bear -ehodie oe women owe iy 










% . : oY 

. _, Dp anes 

P 7 P “ * ‘3 

. Seeks tes yd oar Dofipow gaat) ‘add enw pakeqawe | 


Poieteang. s revi oI yEL\be) emabeye pntrerta 
7 2 A = 4 me Te an 


: 













: eh a Lo ; = y Sr 


20 


early systems had,only a few users, the swapping 
method was satisfactory; but with the introduction 
of large time-sharing systems with many users, the 
shortcomings of swapping became evident. This was 
especially due to the great amount of time needed to 
swap the programs in and out of core. 

A partial solution was to allow more than one 
program to remain in core at the same time ina 
multiprogramming fashion. However, as always when 
more capacity is available, the size of programs 
increased until any two programs overflowed the 


storage capacity, and new algorithms were required. 


Jed eee aging 


Rather than require that the entire program be 
resident in core during execution, one solution lies 
in allowing the job to execute with only part of the 
program andVdatatactually*residing“in* core. (This is 
the principle behind paging. By breaking all informa- 
tion into small units of storage called pages, it is 
possible to keep in core only those pages of a program 
required to remain active. If more information is 
needed for continued execution, only that Bee which 
contains the needed information is brought into core. 

The desired effect of paging is to optimize the 


number of users who can actively use core simultaneously. 
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This, of course, directly affects the service to the 
user as well as optimizing the utilization of core 
storage. 

The implications of paging on the duties of the 
operating system are analogous, and in addition, to 
those introduced by time-slicing (see Sec. 2.1). The 
absence of a page implies an interruption in process- 
ing, during which the operating system must find the 
missing page in backup storage, decide where to put it 
in core, and then bring it into core. The implementation 
of paging has had a major effect on the operating systems 
involved. "In fact storage allocation has come to be 
regarded as one of the basic responsibilities of the 
computer system itself" [21]. There are two areas of 


responsibility involved - addressing and the moving of 


pages. 
2.2.1.1 Addressing and Virtual Addressing 


Because a program may not reside in core in its 
entirety, each reference to an address must now be 
checked to ensure that the addressed information does 
indeed reside in core. If it does not, then execution 
of that program must be suspended while the required 
page is moved into core. Even if the needed page is in 


core, the duties of the operating system in referencing 
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the page are not over, since the pages belonging to 
one program are scattered throughout core and each one 
must be located separately. 

The operating system is thus responsible for 
translating all addresses referenced during execution 
into the real addresses of the information. This 
translation is done by means of a procedure which is 
usually partly hardware and partly software and 


involving a series of mappings. A simple such mapping 


scheme is illustrated in Fig. 2.4. 
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Fig. 2.4 Address Mappings 


An important consequence, to the user, which arose 


from the addressing techniques introduced by mapping, 
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was the concept of virtual addressing. Because it 

was no longer necessary for the entire program to 

reside in core during execution, a program was no 

longer limited by the size of core memory. The task 

of executing a program of say 64 K words, in a memory 
with a size of say 32 K words, would be accomplished 
entirely by paging. It would be done with no assistance 
from the user who would normally be unaware of the size 


of the actual memory. 


2.2.1.2 Page Management 


The second area of responsibility introduced by 
paging was in the method used to move pages in and out 
of core. To move a page in, there are three obvious 
strategies possible. A page can be brought in before 
it is needed, or at the moment it is needed, or later 
at the convenience of the system. 

‘The first method is most ideal in that it would 
prevent a program from waiting for missing pages. 
However it is also the most impractical in that it 
requires prior knowledge of which pages the program 
is going to need. Such information is generally not 
available, although research [14] has been carried 
out to determine if any patterns exist. Research is 


also being conducted in the third approach [4, 9] which 
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is probably the most practical paging strategy because 
it enables better utilization of I/0 devices. 

However, the second method, which is called 
demand paging, has been used almost exclusively to 
date. A page is brought into core only on demand - 
at the moment it is needed. Demand paging has the 
desired effect of minimizing the amount of core storage 
allocated to each program. Since this is the method 
used by CP/67, it will be discussed further in Chapter 
TAY 

Whatever the method selected however, the real 
problem is not in deciding which page to bring in, 
but in deciding which page to remove in order to make 
room for the new page. The best decision would be to 
remove the page with the least likelihood of being 
needed in the immediate future [10]. Again various 
schemes, better known as page replacement algorithms, 
have been developed to make these decisions. Their 
situation is analogous to that of the scheduling 
algorithm's in that they are required to make decisions 
about the future paging requirements using knowledge 
only of the past. Yet their decision can have a 


* 
Signiticanteerreew ont thee pages trartic*p and=hence? on 


* 
page traffic - the number of pages per unit time 


being moved between memories [10]. 
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ene performance of the system (see Chapter III, 

SCC. 4a.4. 4) Any decision to remove a page which 
is going to be needed immediately is obviously a bad 
decision. 

Two of the basic techniques used by these 
algorithms are outlined as follows: the First-in, 
First-out (FIFO) algorithm says whenever a fresh 
page is needed, the page which currently has resided 
in core the longest is chosen to be moved out. ‘The 
Least Recently Used (LRU) algorithm says whenever a 
fresh page is needed, the page which has remained 
unreferenced for the longest time is chosen to be 
moved out. 

Again there are variations and other considerations 
such as whether or not the page chosen actually needs 
to be rewritten into secondary storage. If it has not 
been altered in any way while in core, then it's original 
image still remains in secondary storage and there is 
no need to move it back (providing a record is kept on 
which pages have been altered). Thus choosing an un- 
altered page will reduce the page swapping time to a 
half. 

The responsibility of the page replacement algorithm 
becomes evident when one considers how as the number of 


users in core increases, the more paging is required; and 
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as more paging is required, the longer users must 
occupy core (waiting for pages), and the more crowded 
it becomes .... The situation then arises where the 
system is doing little else except paging. All users 
will be waiting for pages and no useful work will be 
accomplished. Such a condition is called thrashing 


and is discussed in more detail by Denning [11]. 


SEaGOncLus ion 


Time-sharing systems are primarily an attempt to 
provide easy access and good service to the computer 
user. A secondary objective is to achieve better 
utilization of the computers resources. Both these 
objectives can be met by allowing many users access 
torthe computer concurrently." Conflicting demands for 
the use of computer resources are handled by scheduling 
techniques. 

Although actual implementation of such systems 
have shown their potential, their performance under 
heavy load is still questionable. Although some limit 
is expected as to the load such systems can efficiently 
handle, the actual limit is quite often lower than 


expected. 
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Performance in these systems is a measure made 
up of many interactive variables. The effectiveness 
of the scheduling algorithm, the effectiveness of the 
page replacement algorithm, the amount of overhead 
involved in each of these, and the time required to 
transfer a page are some of these variables. Each 
contributes to the length of time a job remains active 
in order to complete its execution. The longer a job 
is active, the longer the response time to the user, 
and the greater the probability that another job will 
require the same resources, resulting in further delays 
and congestion. 

Lieper formance! sis sound, ito be junsatisfiactory, 
the question arises as to which of these variables 
Gause iene poom) pert oumance.= jin -the: next «chapter we 
investigate methods of measuring and evaluating time- 


sharing systems in order to analyze their performance. 
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CHAPTER liek 


SYSTEM EVALUATION AND MEASUREMENT 


Iv=ThesNeeo for’ Evaluation 


Progress in designing and applying informa- 
tion handling systems has outraced progress 
in evaluating their performance [2 ]. 
Within the past several years, technology 
has outstripped methodology in the evalua- 


tion of large information processing 
systems [36]. 


Although these statements are now three years old, 
they reflect a situation still existing within the 
computer industry which was brought about by the devel- 
opment of time-sharing software systems. These new 
computer systems have produced a significant and some- 
what unanticipated increase in complexity. Methods of 
evaluating system performance progressed too slowly, 
with the result that many of the new systems were 
developed and implemented without the assistance of 
proper analysis. 

The changes introduced by these systems were the 
result of three closely related factors. The first 
was the influence of the hardware configuration on the 
operation and performance of the system. Formerly 
hardware systems were usually obtained as a sort of 


"package deal", with different packages available for 
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different applications or size of operation. However 
time-sharing systems are more frequently "tailor made", 
using a variety of possible components. Size and 
speed of core; number of drums; number, size and speed 
of disks; number of data channels, are some of the 
variables to consider in "building" a time-sharing 
computer system. 

The second eneter was the increased role of the 
software (operating system) in the total operation, 
and hence performance, of the system. Software com- 
ponents such as.the interrupt handling routines, the 
scheduling algorithm, and the space management routines 
havea substantial effect on the overall performance of 
aesysten’. 

The third, and perhaps most important, factor was 
the great interdependence of the various software and 
hardware components just mentioned. The effectiveness 
of the software depended on the efficiency of the 
hardware, and vice versa. The total result of these 
changes was a broadening (or obscuring perhaps) of the 
definition of system performance. This chapter will 
discuss methods of defining, measuring, and evaluating 


system performance. 
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2 Methods of Evaluation 


The evaluation of time-sharing systems is far 
from being a science. Good systems evaluation involves 
a great deal of ingenuity, guess-work, and common sense, 
with the biggest assets being experience and general 
knowledge in the field of computer systems. As far as 
actual methodology, the techniques used generally fall 


into three categories: 


a) empirical analysis 
b) analytical modeling 


e) simulation: 


These three methods are not distinct and might better 
be thought of as successive levels in evaluating 
computer systems. The level used can be chosen to fit 
the level of understanding of the system and the degree 
of analysis desired. 

Before going on, it is important to emphasize 
that implicit behind all these methods is the necessity 
for measurement of the real system under study. Mea- 
surement involves the gathering of quantitative data 
on the behavior of that system. As Cantrell states; 
"All good analysis consists of a combination of theore- 
tical analysis and empirical measurement" [3]. 


Measurement is needed to give relevance to the theore- 


. , } 
~~ , t pie 


. *, i] 
7 7 as 7 7 ; 
rir ah a At ‘ 

















f 
a 4 
ng Aewiors, Zo shone ok 
rr 4 iis ake) o< fy i LAS SAT 
02 .sbtuch? & 20S eR. Sa 
i ri F =k : 6 
= in .wkuiwoenrt 2 fsat tan 
' 
peasy ‘yapnid ste ¢tie 
sy saris. TO ied it och spo Iiwons 
‘ fobotton tsaaae 
# } e9 apiaes 4 
2 ts J rome ts 
) f S td 
>. f y f "y co 
‘i : g \ j rf vs be ) Seete Ty i 
i z % 
aly fe f 20 Ui pero a> 
{ : . ' “~ 
istaye tala 
; ; | : ~ ‘ 
in Shiu: 20° Ravel ony 
i ; “r pl : 
iT LAS.. 2) Sie eee to 
- aw 
ft f {ii 4 JG TS J a Ree hy 38 
ei 4 Five : : j yi { é is i ner 4 I te z for itt J earkt at 
“i ; re P : . 3 
mF) | , y A 


SALES MBanay 2 Jb O its SAbt> FQ 54) Same eth OE 207 
piixeiicy att, aavibayak dasmorkeliee 
a i aot, ei . y ' . re cs 7 t 


ae 
ft 





/ 
t - 
is he ¥ 









oa 


tical analysis. The question of how to obtain measure- 


ments of a system's behavior is discussed in Sec. 2.2. 


Joleelnieoretical, Analysis 


207 lekinpieicaliAnalysis 


Although the terms “theoretical” and "empirical" 
seem somewhat contradictory, they are used together 
in the sense that theoretical analysis is achieved 
Simply through an understanding of how a system is 
supposed to work. Empirical analysis is the method of 
examining the quantitative data obtained from measure- 
ment and deducing the systems performance from this. 
(Examination of the data includes data compilation and 
analysis, since the raw data is seldom in a comprehen- 
sive form suitable for immediate "empirical" analysis.) 
The depth of this examination may vary depending on the 
researcher's degree of understanding of the system, the 
object of the research, and the content value of the 
data within this objective. Simply by examining the 
measurement results, then, it may be possible to 
discover problem areas within the system's performance. 

The, one baste drawback CO. this method is that it 
has very limited predictive powers. Any decisions made 
mist, be besedron thercoliescted data. To actually test 


any proposed improvements, they must be implemented and 
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new data obtained for examination. Also it is usually 
difficult to predict the performance of the system 
under a different workload using this method. This is 
particularly true for time-sharing systems, since their 
complex interactive nature is very unpredictable under 
changing load conditions. The value of empirical 
analysis, then, is limited to immediate performance 


problems. 


201.2 Analytical Modeling 


Analytical modeling is an attempt to analyze the 
behavior of a computer system from a mathematical view- 
point. Because the operation of time-sharing systems 
is centered around the principles of scheduling and 
queues, it can often be described, and analyzed, within 
the boundaries of queueing theory. The method involves 
describing the system in mathematical terms and apply- 
ing queueing theory to this description. The results 
of the queueing analysis can then be taken as an indi- 
cation of the behavior of the real system. The effect 
is, essentially, a mathematical simulation of the system. 

More specifically, the description of a system is 
usually subdivided into two parts - one, the demands or 


workload entering the system and two, the actions of the 
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system on the workload. The demands are defined in 
terms of: 

a) their rate of arrival 

b) their size. 

Ror, example, a demand may be a request for processor 
cCimeyommjemrequest for core space. The rate of. arrival 
and size can be described mathematically as, say, an 
exponential distribution. Using queueing theory, 
results can be obtained such as the average response 
time or the average waiting time in a particular queue. 

Analytical modeling, then, is useful for gaining 
insight into the work flow pattern through the various 
queues of a system and it can help to uncover areas 
which are reducing the smooth flow of work. It contains 
more predictive capabilities than empirical analysis 
pce possible workloads can be examined by merely re- 
defining the demands. Hence it is easier to examine 
the system behavior under varying load conditions. 

The disadvantage of analytic models is in their 
limited applicability. They are limited by the assump- 
tions that the system behavior must follow the rigid 
laws of mathematics and queueing theory. As such, 
analytic models are generally useful only for analysing 


parts of a system and it is usually not possible to 
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combine these parts to analyse the whole system. As 
a result, they do not adequately reflect the inter- 
action between the various components of a time- 

sharing system which, as we have stated, has such a 


Significant effect on their overall performance. 


Ze oe OLIN La CLon 


Rather than defining a mathematical model of a 
system, simulation is an attempt to build a logical 
model of the system. Simulation is generally considered 
as a last resort when the system becomes too complex for 
an analytic model. It is considered as a last resort 
because it requires even more work and understanding 
than is needed by other methods. The biggest disadvan- 
tage of simulation is the amount of time and effort 
needed to define a logical model of a complex computer 
system. However, if carefully done, simulation can 
bring results where other methods fail. 

As before, the construction of a simulation model 
involves both a description of the workload entering 
the system and a description of the actions of the 
system on this workload. The workload is again defined 
in terms of the size of the demand and their rate of 
arrival. However, the actions of the system are defined 


logically rather than mathematically, and this is where 
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crucial difference lies. Simulation considers time 

as one of the key variables and treats each action as 

a discrete event occurring in a time sequence. Hence 

it is able to consider changes of state as a function 

of time and it can make logical decisions based on the 
present state of the system. For this reason simula- 
tion is able to model the dynamic, interactive influences 
involved, and to give a more complete representation of 
the total system behavior. 

Simulation is also more easily parameterized. 
Because of its logical base, it is able to include a 
wider variety of conditions which are not well behaved 
mathematically. This makes it easier to include in the 
model any proposed changes to the real system, and hence 
to study their effect on the system's behavior. A good 
example om simulations versatility as its > ability ‘to 
characterize an individual user or class of users in 
a time-sharing system. 

Because simulation is more complete in its repre- 
sentation of the system, it forces the analyst to obtain 
a greater degree of understanding of all aspects of the 
system. And because it generally includes a wider range 
of variables in representing the system, simulation will 
usually require a wider range of measurements from the 


real system, again requiring a greater degree of detailed 
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knowledge. Simulation also includes the problem of 
writing a program to represent the model, and although 
several simulation languages have been developed, the 
programming and the verifying of the model's accuracy 


Ls "a tedrous’ task: 


2.2 System Measurement 


In the empirical analysis of a system, the value 
of system measurement is obvious. The data collected 
is\ used as a direct source for pinpointing problem areas. 
Regardless Ofewhether the data can uncover ways of 
improving the performance, it can still be useful in 
indicating areas in which further analysis is required. 
In the latter case, the value of system measurement 
becomes twofold - first, it is used to obtain relevant 
parameters for a model design, and secondly, the data 


rs"later used to*test the’ validity of the model. 


2.2.1 What to Measure 


The immediate question is what to measure. In 
a time-sharing system there are a large number of 
variables involved in the total operation of the 
system, and thus a first step in analysing these 
systems is to identify the variables which influence 


the system's performance. Since the importance of 
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each variable depends to a great extent upon the objec- 
tives of the study, there is no straightforward way of 
selecting the important variables. 

The next consideration is the selection of a 
criterion for measuring these variables quantitatively. 
This section discusses system performance in more 
detail, and examines the possible criteria for mea- 
suring the performance. Following this we will discuss 
methods of actually obtaining such measurements (Sec. 


PADIS PAVE 


2e2-1) papoervice, to..the.User 


Since a time-sharing system is primarily concerned 
with providing fast, if not immediate, service to the 
Leques cs Olg at, S users, 1 follows that- the primary 
performance measurement will be how quickly the system 
responds to the users' requests. (The response time 
was described previously as the time between the entry 
of a user's request for service and the completion of 
that request as seen by the user.) However the measure- 
ment of response time, per se, without considering the 
nature of the request is not very meaningful. By 
measuring response time as a function of the size of 
the request, it is possible to relate actual response 


time to that expected by the user and thus establish 
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different performance criteria for different requests. 
In particular, short "conversational" requests should 
be measured separately from the longer "computing" 


mequests. 


Meee UCL sae LOneOLr Resources 


AsSecstateugine Chapter Ill, Sec. 1.2, the secondary 
performance criterion is the utilization of computer 
resources, especially time and space. In a time-sharing 
system there is a wide variety of specific measurements 
which might yield a suitable measure for this criterion. 

First, if we are concerned with how the system 
allocates its processor time, the obvious measure to 
use is the CPU utilization. Again this measure is not 
very meaningful Hee it is given in relation to the 
total amount of processor time requested by the users. 
Also, bree the CPU utilization includes "problem time" 
and overhead, it is important to measure the different 
types of CPU utilization. 

Second, if we are concerned with how the system 
allocates its storage space, then our biggest concern 
is to obtain a measure of the efficiency of the system 
in moving information between core and secondary storage. 
Such a measure is often difficult to define, particu- 


larly on those systems which implement paging in their 
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storage management. On such systems efficient storage 
management not only involves the efficient transfering 
of information between storage areas, but also the 
Minimizing of the number of necessary transfers. 

A suitable measure of the efficiency of informa- 
ELOne transfers) iSaprobably sthe traffic, atthe, channels. 
With analysis of this information we can often obtain 
a measure of the amount of time a storage demand might 
expect to wait unnecessarily while the channel is busy. 
If this expected time can be lessened, then hopefully 
we are achieving better utilization of storage facilities. 

In a paging system another good measure of effi- 
Ci enevyrOlespaceeUti lazation,is-simply jche) pageiitrafifiic — 
or, in other words, how well the operating system keeps 
the number of page transfers to a minimum. Or, as 
McCredie [23] suggests, a proper evaluation of a given 
page replacement algorithm should consider both the 
overhead necessary to process a page as well as the 
number of these faults. Excess overhead in executing 
the algorithm will override any advantages obtained by 
making a "good" decision. 

Kuehner and Randell[21] consider that the time 
required to fetch a vpageis thescritical factor in the 


performance of a paging system. They suggest, as does 
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Joseph [19], that the “space-time product" is a good 
measure of a paging algorithm's effectiveness. The 
Space-time product (see Fig. 3.1) is the product of 
the size of an active program in core and the time it 
Spends in core. The size of the program will vary 
according to the number of pages it has in core at 
aivyeperticuler time. If the time required to fetch 

a page is large, it can be seen that a large proportion 
of the space-time product will represent the amount of 
time the program occupies working storage but is inac- 
tive waiting for the arrival of another page. This 
measure is very useful in indicating the improvement 
in performance that could be achieved by lowering the 


page-wait time. 


Space 





Time 
4] Program in Pagewait 
ES Program Active 
P = Ave. time to fetch a page 


Fig. 3.1 Space-Time Product 
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Thus there is a wide variety of measurements 
that can besused' to andicate the efficiency of re- 
source utilization. We have suggested only a few 
which are generally considered to be the basic per- 
formance measures. It must also be realized that all 
these measurements are a function of other variables, 


particularly the load on the system. 


2e2ce How to Measure 


After deciding what measurements should be made, 
the problem becomes how to obtain these figures. 
gndeed the greatest percentage of time in a system's 
evaluation project is usually spent in the collection 
and reduction of real world data. 

The importance of the data gathering techniques 
in the overall planning of a project must be emphasized. 
The questions of what to measure and how to measure it 
are by no means distinct decisions. Often the exact 
figures wanted are not available within the means of 
data collection and, as a result, alternative figures 
have to be obtained. If relevant data cannot be obtained, 
the feasibility of theventire project, or the validity of 


its results are in jeopardy. 


2. 2ae tive DabasGolLlection 


Measurement techniques can be divided into two 


categories: 
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a) hardware 

b) software techniques. 

Hardware measurement involves the use of a hardware 
device to record activity within the computer. The 
big advantage of this technique is that it imposes no 
interference on the system it is measuring. Also the 
figures obtained are very precise. This is especially 
valuable if essential measurements involve small time 
intervals, which is usually the case. The big dis- 
advantage of hardware measurement is in the time and 
knowledge needed to initially develop the necessary 
device. Also hardware measurement is limited to 
measuring hardware features such as a CPU in wait 
state, or a channel busy, etc., and will not measure 
many software features. Shulman [36] and Roek [30] 
discuss specific applications of hardware measurement 
devices. 

Software measurement involves one modification 
of the existing operating system to extract informa- 
tion during the operation of the system. The dis- 
advantage, of course, is that this uses CPU time and 
storage space, and therefore interferes with the 
normal operation of the system. The advantage of 
software measurement is that it allows access to 


information on the functioning of the software 
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components such as operating system overhead, etc. 
Also the range of information obtainable is greater 
Since software is generally easier to modify than 
hardware. 

Deniston [8 ] and Pinkerton [29] describe the 
use of two specific software measurement applications. 
A unigue software technique, which was used to obtain 
data from the CP/67 time-sharing system, will be 


discussed in Chapter V. 


wae ed oe DatcaaReaqucc von 


Regardless of the measurement technique used, 
the next problem is to reduce or condense the raw data. 
TieOrme tone rLOmthewdata must be converted into a 
meaningful format for the human analyst. This can 
often involve developing quite complex programs capable 
of recognizing hidden events or behavior patterns of 
Significance. Only then can the theoretical analysis 


of the data begin. 


3 AnvAltLernative Approachy lo: Systems Evaluation 


Karush [20] presents an alternative approach to 
the empirical measurement-theoretical analysis 
philosophy presented here. His method is analogous 


to the benchmark techniques used to evaluate non-time- 
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sharing systems. It involves the development of 
"stimulus" programs which are designed to test the 
system under actual operating conditions by simply 
executing these programs. Results are obtained merely 
by measuring the external response of the system to 
these stimuli. 

The advantage of this stimulus approach is that 
results are obtained easily and immediately. There 
is little data reduction necessary nor does it involve 
the complexities of getting "“into" a system to obtain 
the data or the degree of understanding needed for 
theoretical analysis. The disadvantage of this approach 
is again that the range of measured performance is 
tamited to the actual computer operation, and it is not 
easy to experiment with alternative system configura- 
PONS ee SO;e tt COCs PDOL, DrOvVide any data on, the 
secondary performance criteria (i.e. resource utiliza- 
tion) which could be helpful in improving the overall 


performance. 


4 5Conclusions 


Since all methods of evaluating a computer system 
seem to have some disadvantages, many factors must be 
considered in making a choice of the best approach. 


The objectives of the evaluation project (i.e. the 
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degree of analysis desired) is, of course, the most 
important factor. _Others which can have a signifi- 
cant influence include knowledge of the system, the 
measurement techniques available, the data available, 
time available, as well as experience in computer 
systems generally. 

In the next chapter, we begin a description of 
a specific project undertaken by the author involving 


the evaluation of a time-sharing system. 
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CHAPTER IV 


‘AN EVALUATION OF THE CP/67 TIME-SHARING SYSTEM 


tC OjeCelves 

The first obvious step in undertaking any evalua- 
tion project is to set down some objectives for the 
study. The project presented here was centered around 
an evaluation, using simulation, of the job scheduling 
algorithm of the CP/67 time-sharing system. The 
primary object of the study was to investigate the 
relationships between the performance of the system 
and various parameters of the scheduling algorithm. 
Inherent in this objective was the idea that the 
simulation model could be used to find areas where 
present system performance could be improved by 
changing certain parameters, or perhaps even altering 
the design of the scheduling routine. The system 
performance under various load conditions was also 
investigated. 

More specifically, this project is concerned 
with analysing the CP/67 system performance as it 
pertains to the management of its time resource. (The 


second aspect of system performance, space management, is 


aliguecdt Onions no. Cealt wath-in oetail.) The two. measures 
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used are the response time and the CPU utilization, 
both of which fall under the responsibility of the 
scheduling algorithm. Response time is measured in 
relation to the size of the request and the load on 
Bhiems yocenwesic rload Ton ythesystem tis definedi:solely by the 
number and type of users on the system. CPU utilization 
is obtained by examining variations in the amount of 
time spent by the processor in wait state, supervisor 
Stave ~eOurprobilemistateaa Thexnratro rot, timeiispent tin 
supervisor state to time spent in problem state is one 
measure in which improvement is expected. 

Parameters of the scheduler which may be altered 
include the length of the time-slice, the maximum queue 
lengths allowed, and the quantum (or time-limit) allowed 
in each queue. The overall objective is to alter these 
parameters on a Simulation model and thus determine 
their effect on the performance of the CP/67 system 
under various load conditions. The results would be 


useful in improving the operation of CP/67. 


werGenera PIVESCEIpL LON OraC P76] 


The particular time-sharing system involved in 
this project was the CP/67 installation at the University 
of Alberta (U of A). CP/67 is a control program designed 


by IBM at Cambridge Research Center for implementation 













wi} Fup met compete —ont sai i te beans 
: Pa i Lithia ae r ot’ tefad Liat dottw Io aged 
\ ae 
y , ‘; 7 Ji i &. q a4 » ps Lohevioe~ 
wit OF aoijster 


~fteve eng 


we tscnun 


3 
boys 
he 


eye otis " ) Al (H2ega 
~ - 
i 


\ 
‘- % . 


¢ zi > oe 1B tie? wi ebu toar 
' ioe , bowolls andipaed 
y .euaup mee Az 


s ~ 
; Ji (iis i ay i { Sh T6g 


4 . wNOTSS off 06 toe%%o teeds 


- tae 


. fhhiywon beel avoliteavy 1*e6bom 






VEX 10° 4 yo wit pryvargmt nt lutses 







se a, r TO\Sa- de api 2gizoeed {e1s099 s 





® ' 
ad - ww - _ 


if 





' : ‘ + \ ¥ inne _ 
Poy ee ee ee os ris 
f 





4 a. st -_ 


48 


On an IBM System/360, Model 67. It is designed to 
provide a time-sharing environment in which each user 
believes that he has the complete resources of the 
computer dedicated to his use. It achieves this objec- 
tive by generating a "virtual computer" for each active 
user and then by sharing the resources of the real 
computer amoung these virtual computers. 

The concept of virtual computers is closely 
related to that of virtual addressing, which was intro- 
Ggucediin Chapter Li. Virtual computers function like 
real ones but_are the product of software simulation. 
Under CP/67, the user is initially assigned a virtual 
computer with the configuration of his choice and a 
CP/67 identification number. Different users may have 
different configurations depending on their needs. 

When a user signs on, CP/67 creates a virtual computer 
of his predefined configuration. To the user, his 
virtual machine appears as a real computer and he uses 
it as if he were at the main console of a real computer. 

The user is able to equip his virtual machine 
with any operating system that will run on an IBM 
360/65 and give him the desired functional capabilities. 
In most cases CMS (Cambridge Monitor System) is used, 
although other supervisors such as OS and APL, under 


DOS, are also used. CMS is a single-user, conversational 
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Operating system designed especially to operate under 
CPIAG (Ay Choa gives) thes user, the ability to, initiate, 
monitor, and terminate his program by carrying on a 


command-response type dialogue with the (CMS) system. 


3 Previous Evaluation Studies 


Bo beehvaluation Studies on CP/67 


Of particular interest here is an earlier evalu- 
ation study carried out by A. Gatha [15] on the same 
CEG inscallaciongat. thesU, of As. This study was of 
the empirical analysis type in which data on the 
system was collected and analyzed statistically to 
evaluate the system performance. One of the most 
important results of Gatha's work was the method 
developed for collecting data from CP/67. His method 
was extended by the author for this study and is 
precusced imedetails inoGhapter, Vv. 

Ine brie. “eee Gatha's results show that the 
paging load (total number of pages transferred in or 
out of core) increases exponentially with the number 
of users on the system. meen his data, he calculates 
that with 16 users the paging (disk) channel capacity 
would be exceeded. He also concludes from his data 
that it would be unrealistic to expect the average time 


spent in problem mode to be much greater than 75%. 
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That is, when the system is loaded, at least 25% of 
the CPU time would be necessary for supervisory 
duties (i.e. overhead). At this rate, he conjectured 
that maximum CPU utilization would be reached with 21 
users. However the limiting factor in CP/67's user 
capacity, according to Gatha's evaluation, would 
appear to be in the paging capacity of the disk channel. 

Gatha's results must be qualified if they are to 
be compared with the results obtained in this study. 

At the time of his research, CP/67 paging was handled 
with disk storage only, whereas at the time of this 
research it was handled with drum storage, with disk 
being used only as backup to the drum’, Also, the size 
of core memory increased from 512 K to 768 K during the 
intervening time. 

Another evaluation study of CP/67 at the U of A 
Wasecarriea oul by O.S. Bishop [ ])] using: the, analy-— 
tical modeling approach. He developed a priority 
queueing model in which system interrupts were treated 
aS arriving from a preemptive queue with top priority. 
User requests were treated as arriving: from two non- 
preemptive queues with a foreground-background type 
priority scheme. All three queues were, of course, 


competing for service from a single CPU. 





The transfer rate from the drum is 4 times faster 
than thie transier rate from the disk. 


teh 


However, because he had no measurement data 
from which to accurately describe the input to his 
model, his results do not describe the performance 


of the existing system nor indicate its capacity. 


Srerveivaluation ctudies on Other Systems 


The results of some other evaluation studies of 
different time-sharing systems are of interest. 
Scherr [33], for example, made a study of Project 
MAC's Compatible Time-Sharing System (CTSS) using 
both analytical and simulation models. The primary 
measure of system performance was the response time. 
Because of the accuracy of his Markov model in predict- 
ing the performance of the system, even when it was a 
highly simplified version, Scherr concludes that 
performance is determined in large part by only the 
mean interarrival time of requests, the mean request 
size, and the number of users signed on. The results 
of his simulation studies also point out that good 
accuracy can be obtained from a fairly simple model. 
CTSS, however, does not implement paging so his results 
cannot be compared directly with the — from this 
study. 

Oppenheimer and Weizer [28] carried out a simula- 


tion study on the RCA Spectra 70/46 Time-Sharing Operating 
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System (TSOS). They also used response time as a 
primary measure of system performance. TSOS uses 
paging. They conclude from their results that secon- 


dary storage should be a drum or non-moving arm disk, 
since any slower device becomes a bottleneck for the 
entire system and significantly lowers the system 
performance. They also suggest that a mechanism should 
be provided for continuously monitoring and adjusting 
the load on critical system resources, such as I/O 
channels and memory, to prevent overloading. Since 
their results also showed that very few requests required 
a full time-slice before being halted by an interrupt, 
or by completion of the request, they conclude that the 
Stemi euime—-cl1Ce 1S eno Critical., As a result, 
they settled on a time-slice of 2 seconds for use in 
the system. The main value of the time-slice is that 
it prevents long tasks from monopolizing the processor. 
Nielsen [26] performed a simulation study on the 
IBM 360/67 Time-Sharing System (TSS, version 1). Since 
simulating the paging characteristics of a time-sharing 
system is very complex, Nielsen devotes another article 
[27] on his approach to this problem. Using the CPU 
utilization and response time as the measures of system 
performance, Nielsen also pinpointed the major source 
of poor performance to the bottleneck created by slow 


secondary storage devices used in paging. 
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All authors agreed that their results demons- 
trated the ability of simulation to provide valuable 
insiqnesPinconune Characteristics of complex .time- 


sharing systems. 


se Vetaticd Veperipciron of CP/G? 


CP/67 is responsible for creating a time-shared, 
virtual environment. It accomplishes this by [6 ]: 
a) scheduling and allocating main storage 
space, CPU time, and I/O devices to the 
Virtual computers; 

b)ehandling-all interrupts; 

c) protecting system files, users' programs, 
and users' data during execution; and 

djmieceping statistics on the use and pertor— 
mance of the "real" system. 

In this project we are primarily concerned with 
the CP/67 job scheduler and how it creates the time- 
shared environment (Sec. 4.2). However the implemen- 
tation of virtual, machines will be discussed first, 
Since some knowledge of the total responsibilities of 
CP/67 is necessary for a better understanding of the 


duties of the scheduler. 
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4.1 CP/67) Virtual. Environment 


As suggested, virtual computers are the product 
Grecottwareroinulativon. Lt ts=tne auty of the control 
program, in this case*CP/6/*,"’to translate’ all virtual 
references into their real equivalent. This transla- 
tion process is carried out through a series of mappings 
between a set of tables maintained by the control 
pEOg rane A COMmplete, and dynamic,= description of 
each virtual computer is maintained in these tables. 

To understand the virtual environment of CP/67 for our 
purposes, it will be sufficient to describe some of the 


tables and mappings involved. 


Ale CLA BIE 


For each user which is signed on to CP/67, there 
exists a primary user control block callea the UTABLE. 
Along with the virtual I/O blocks, the UTABLE completely 
reflects the status, of the virtual machine. The UTABLE 
is a starting point from which CP/67 is able to reference 
any information it needs. 

Some of the information included in the UTABLE 
is: 

a)”> VPSW'="“*the user‘s virtual PSW (program Status 

word) ; 

b) SEGTABLE - pointer to the user's segment 


table; 
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Gc) VMSTATUS..— a byte reflecting the state of 
the virtual machine, where 
| X'80' indicates PAGEWAIT, 
O40 imdicates’ IOWAIT, and 
X'20' indicates CFWAIT; 

ad) VTOTTIME - time used by virtual machine: in 
problem mode since Signed on; 

e) TIMEUSED - time used charged to virtual 
machine since signed on (includes VTOTTIME 
plus CP/67 overhead) ; 

tf) = NEXTUSER. —spointen: co mextipuser's UTABLE; 

g)) USERID» —"user’s CP/67 identification; 

h) PENDING - contains a bit for each selector 
channel which has a pending interrupt; 

PeeCPROUMST= = pOimter LO stack Of Control program 
execution request blocks; 

OVX START=—" pointer’ to the first virtual device 
block on the virtual multiplexor channel; 

kK" VEHSTART#= pointer to~ the first selector Channel 


DOCK. 


Awl. 2 eAddressing;, Paging, ano gv ibruale 1/0 
The technigues used by CP/67 to reference informa- 
tion are outlined in detail in Appendix A. Again they 


basically involve the use of various tables and mappings 
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by which the system is able to find the real location 
of information referenced by the virtual machine. 

Fig. 2.4 (Chapter II) illustrates a simple example of 
how virtual information is addressed. If a page is 
found not to be in core when needed, similar mappings 
locate the page in secondary storage and the page is 
read Ins similarly =ror virtual“1/0, -all references 

to virtual devices are translated, via tables, into 
their real equivalent. When the real I/O is completed 
this process is reversed and the real operation is 


reflected back to the virtual machine. 


4.2 CP/67 Time-Sharing Environment 


Aen GeneLe I OULLeS) OLeDLSPATCH 


When all interrupt handling routines in CP/67 
complete their processing, they transfer control to 
the main job scheduler and control routine, which is 
Called DISPATCH. “The duties of DISPATCH are: 

a) to charge all time used to the appropriate 

user(s); and 

b) to determine the next user to receive control 

and to pass control to him. 

To prevent overloading, DISPATCH allows only a 
subset of all users to be active at any given time. 


DISPATCH maintains two queues of active users, both of 
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which have a maximum limit on their size. One queue 
(Q,) is maintained for interactive users, whose sae 
are characteristically small, and another queue (Q.) is 
Maintained for those users whose requests are for larger 
amounts of processor time. If a user desires to enter 
a queue (i.e. become active) and that queue is full, he 
must wait until another user leaves that queue. 
A user is in one of the following five states at 
any given time: 
a) waiting to enter Q (ath Q,-WAIT) ; 
b) in Q); 
c) waiting to enter Q, CL Q,-WAIT) ; 
Cyeain Q5i or 
e) inactive, not requiring system resources. 
In addition, an active user may or may not be runnable. 
A user’rsanrunnable it -he*ts: 
a) in PAGEWAIT - waiting for a page to be brought 
in; 
pyVins LOWALYT*—*wai Cing “for the-inrevation Cr some 
I/O operation; 
c) in CFWAIT - waiting for a response from the 
féerminaly *or 
d) in WAIT - the virtual machine is waiting for 


work. 
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Note that an unrunnable user is still active (i.e. a 
member of a queue), although the WAIT condition also 


Occurs whenrche USeErilLsS inactive. 


V2 t time Charged 


Each time DISPATCH is entered, and during its 
own execution, it is responsible for charging all 
time used to the appropriate users. There are two 
exceptions. The time used by DISPATCH in choosing 
a new user is not charged to any specific user, but 
is charged to the system as OVERHEAD. Similarly, time 
spent by the system in an idle state is charged to the 
Syseem as WALTUIME. 

Fig. 4.1 illustrates the time charging scheme used 
by DISPATCH. More detail is given in Appendix B. 

As soon as DISPATCH is entered, it charges the time 
used to handle the current interrupt to the user respon- 
sible, and charges the interrupted user (RUNUSER) for the 
time used by him before he was interrupted. As well as 
being added to the TIMEUSED for RUNUSER, this second 
charge is also added to the user's VTOTTIME (the amount 
of his TIMEUSED actually spent in execution). The rest 
of his TIMEUSED arises from the time spent by CP/67 
in maintaining his virtual environment (i.e. translating 
his virtual interrupts into real interrupts and vice 


versa). 






















" 7 


p if. £) s¥idoes [lise et xseu sidshavone on Deng ar : 
tiibads TYIAW <nd apronsis , (suscep 6 te xodnrom 


j5Bnh Sik toe0' sil? nedy 2IwW930 


Fie Y I. IA? 


(dletogqeby.@2£'31.,foT2voSte ae 
7 ; SI h110U09GUS .6 {7 o3' bese omit 


Jo vd besu srr sm . 290 £3q@eoNse 


Pe ‘ | 
npxedo don ef rsa won & 
5 i+ oF bopsieite = 


“tu 
| 


LHOt a mavgaye of) 4a ieee 

(METTIAW 2S noteye: 
dd e5daxseutsi Sch uit i 

ip f I S235 S204 povaaee yd 


: ; a Lo 7 ~ 
atogus 2f HYTASeiladvcs ‘noas hd 


an. tifow 2A ‘RaeaN fteJui esw of axoted mpd ya seau omit 


. Baoose ehdd \AdaUnus x01 cateaaie: ailineJ. ebb. “pated, 








ceded ve 


f 


29 


Pveerr une 
User running handled DISPATCH executing 
A B G 


fo ceescy ell a am pe gay ae 
TIMEUSED TIMEUSED TIMEUSED TIMEUSED OVERHEAD 
(RUNUSER) (interrupter) (RUNUSER) - - - (USER N) 


eects taal OS a Sa A 


VTOTT IME CEEIMeE: 


Time A - user given control 
Deas neecLEUpGeOCccurs 
C - DISPATCH entered 


N - no. of users Signed on 


Fig. 4.1 Time Charged by DISPATCH 


The amount of time spent in the supervisory state 
is accumulated as CPTIME. This is the time that CP/67 
itself has control of the CPU and can be considered as 
the overhead of the system (not to be confused with 


OVERHEAD as defined above). 
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4.2<h<.2 oNext User Chosen 


The second responsibility of DISPATCH is, of 
course, to select the next user to run. All users 
are chained together via the NEXTUSER pointer in 
their UTABLE. DISPATCH searches each user on this 
chain and selects a user according to the following 
six chorces: 
iL) SRUNUSER?] “rt “StrEP-runnabtie, “and #if he ‘has 
not completed his time-slice, is given 
immediate control for the unused remainder 
of his 50 millisecond” (msec. ) time-slice; 
2) SErsteNeATUSER who “rs in Q1 and is runnable; 
53) serrst NEXTUSER whois in Q, -WAIT and is 
runnable; 
4) Frrst -NEXTUSER “who're =in Q,-WAIT, is runnable, 
and has the highest priority (see item (f) 
below) of all other runnable users waiting 
to enter Q57 
5) PrrstVnexzTusEeERswho?rs?in Qo, is runnable, 
has less than one NOQUANT (see item (e) below), 
and has the highest priority of all other users 
in this ‘same’ class’ (CLASS*©1): 
6) LIrserPNExTuUSERswnho F£s"in Qo: is runnable, has 
at least one NOQUANT, and has the highest 
priority of all other users in this same class 


(CLASS 2). 
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Ti DISPATCH ©S Unable to find a user to’ run, it puts 
CP/G7 Intola waite state for an Tole cycle! of 25 
seconds (sec.). 

There are several important items to note here. 

a) Choices 2-6 are all given a time-slice of 
50 msec. 

b) Choices 1-2 are given control as soon as they 
are found, whereas choices 3-6 are given 
control only after all users have been 
examined once (more detail in Appendix B). 

c) Choices 3-4 are made on the condition that 
the respective queues are not already full. 

d) Users entering Q7 are placed at the back of 
the queue, behind those already in Q,-. Users 
entering Q5 ale placeu- at. tne front of the 
queue, ahead of those already in Q.- 

e) Q, is divided into two internal queues, which 
we will call classes, depending on whether or 
not the user has one or more NOQUANT. When a 
user first enters Qos his NOQUANT its Set to 
zero (i.e. he always enters CLASS ] first). 
It is incremented by one each time he uses a 
full 50 msec. time-slice without an interruption. 
AS Uuserain Q. will remain in CLASS 1 as long as 


he never uses a full time-slice. 





. 4 errs - : s byt? oF Sldcay 21 HOTAIBIG SE 


.(. 908) ebaoose 


ant a 
~~ 
L 
at rig” 
3.9 S+I eagoztana (a 
= ™ 
. ar P : 
1 , WIT , — 
ee ; f f LOY Jiro s 
} i rest 2 
‘ 
ri e 7 
~ r : - ta , i . 
: rf - h ae 
% 
- iy 
f ! > fy 5 co 
f ; a | 
ay ‘ x 
: i i ) Dit 71 
- s 


Cc 


es nad —.'TMAX OMe.stek Yo sno eid doz sid vor 


I 
7 — 


ad toe cintne daikt ween 


=~ 


ah @nayuoor aid ..9 
aa 7 | a7 








62 


i) Q. has an internal priority scheme, covering 
both classes, whereas users in Q) are chosen 
strictly on a FIFO basis (see item (g) below). 


Q, is FIFO within each priority level. The 


2 
priority scheme in Q5 is based on the number 
of 5 sec. quantums that the user has spent 
in Q.- Each time a user completes 5 sec. of 
TIMEUSED in Qor his priority is lowered. 

g) Since DISPATCH begins each search with RUNUSER 
(who generally is a different user each time), 
and although users are selected FIFO within a 
queue, their position in queve depends on their 
relative position to RUNUSER on the NEXTUSER 


Chat eens IncGcocuces a rahcom factor to the 


ordering of the queues. 


ee eRe LEV OnaeaDULTeseOL .DISPATCH 


In addition to the two general duties described 
above, DISPATCH is also responsible, for updating the 
user queues and for maintaining the virtual environment 
of each user. These duties are described in detail in 
Appendix B. Updating the user queues basically involves 
examining each user and placing him in his proper state 
(Q,, Q, “WAIT, Qo1 Q,-WAIT) 1£ he is active... The main- 


tenance of the virtual environment involves examining 
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each user's UTABLE for the presence of CPRQUESTsS and 
PENDING interrupts. Both essentially signify that 
some real interrupt has occurred which affects the 
status of the virtual user-and, if they are found, 
DISPATCH must reflect this change in status to the 


virtual machine. 
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CHAPTERYV 


MODEL AND MEASUREMENT TECHNIQUES 


1 The Simulation Model 


Simulation involves setting up a model of the 
real situation, or system, and then performing experi- 
ments on this model [24]. A computer simulation model 
is a logical-mathematical representation of the real 
system which is programmed to be run on a computer 
[22]. 

Constructing the model of any system involves two 
PaciceGescCeiptions. The first is.a description of the 
input to that system, and the second is a description 
Otethesocevons OL, that ,systemsuponeits input. in a 
computer simulation model, the system input is represented 
mathematically, while the actions of the system are repre- 
sented logically. Thus a program is written which will 
accept the Heehennen cat input and perform the logical 
operations of the system. 

The real system being simulated in this project 
is the job scheduler (DISPATCH) of the CP/67 time- 
sharing system. The CP/67 environment consists of 
several users at remote terminals, each working inde- 


pendently on individual tasks. The model will consist 
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of a description of individual users, in terms of the 
input they represent to the system, as well as a des- 
* 


cription of how DISPATCH handles this input. The 


next two sections will explain the model in more detail. 


L.1 The User Model 


From the user's point of view, the services of 
the CP/67 system are totally dedicated to his indivi- 
dual use. To the user the system is in one of two 
states; either the system is waiting for the user to 
enter a request, or it is working on a request of that 
user and the user is waiting for the system to respond 
(see Eid: oe. 

Since a major portion of the time involved in 
entering a request is taken by the user in merely 
thinking about his next request, this period of time 
will be referred to as the "think time". The think 
time also includes the time involved in typing the 
request and the time to receive the response output. 
The response time begins when the user enters a request 
and ends when the response begins to be sent back to 


the terminal. As well as the time spent actually 


These two parts could be referred to as models of 
the (system) input environment and of the system 
operation. 
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WORKING 


Response time 
Request Response 
entered begins 

>) > 





CP/67 (Overhead) 


User running (S) 


Other users 
running 


|<——_—___—_> | <> | 


Waiting Request 


hows com- 
time pleted 
slice 


5.1 User Model 


executing the request, the response time includes such 


times as that spent waiting to enter a queue, waiting 


for a time-slice (while some other request is running), 


waiting in an unrunnable state 


and system overhead. 


(e.g. PAGEWAIT or IOWAIT), 
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The input demands on a system can be represented 
mathematically in a model by the following two des- 
criptions: 

a) the frequency of the demands 

b) the size of the demands. 

In our model, the individual user is described by two 
such pairs of demand descriptions. The first pair 
describe the user's request, while the second pair 


describe the virtual interrupt requests (see Fig. 5.2). 


User described 


by 
Thi ike times (Xx) Request described 
given by 
F (x) By 
Request size (S) Interrupt 
given by interarrival time (Y) 
G(s) given by 
bins a 
Te ee ea: Interrupu wait time —(L) 
Gio given by 
a W(t) 


Fig. 5.2 Description of Model Input 
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The virtual interrupt request could be considered a 
second level description of the user. On the first 
level, a user is described by the size of his requests 
and their rate of arrival. Each request, in turn, is 
described by the size of its virtual interrupts and 
their rate of arrival. (Higher levels of input descrip- 
tion could be reached by further describing each 
interrupt as to its type or cause; however this would 
require a much greater degree of analysis of the real 
system than was feasible in this study.) 

More specifically, the frequency of user requests 
for processor time is obtained from the think time 


distribution 
DEGAS geile OS Re palo e 


where X is the think time. The size of requests is 


obtained from the request size distribution 
G.ts jepr=- Prob, (S< ss ie, 


where S is the request size. These distributions are 
independent of each other. 
The frequency of virtual interrupts is obtained 


from the interrupt interarrival time distribution 
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where Y is the amount of processing time between the 
occurrence of virtual interrupts within a request and 
S'-is the length of time that a request has already 
SxeCuLrecc mts sac oM (Sec Chapter VLl,~ sec. 1.1.3). The 
Size of the virtual interrupts is obtained from the 


interrupt wait time distribution 


Wier Probl <t) 2 


where T is the length of time a user is unrunnable 
While CE/G/ 1S processing this interrupt. 

All distributions used to describe the user's 
input, except W(t), were obtained directly from the 
measurement data (see Chapter VI). 

Given this model of a user, the behavior of 
CP/67 will be simulated by modeling the interactive 
activities of several of these users as controlled by 


Di oPATCH: 


I.2 othe GPSS,DISPATCH Model 


Several general purpose simulation languages 





have been developed recently as the use of simulation 


has grown. Such languages are designed to relieve the 


analyst of much detailed programming and speed up the 
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process of obtaining results.  Teichroew and Lubin: [37] 


— ‘ . nines , st? ee 
i } 4 ¢ Tapattied ‘5 LS t0eVea6G 


bognloveb. naad aver 7 { 
‘ . > > ew jaw -_y 


(es yitagoor 


ong eed 





70 


give an excellent survey of available simulation 
languages and the considerations which enter into 

the selection of any such language. In this project 
GPSS (General Purpose Simulation System) was selected 
because of its availability. 

The language GPSS [17,18] is based on the assump- 
tion that any system can be represented in terms of a 
small set of abstract elements called “entities". 
Likewise the logical rules governing any system can 
be reduced to a common set of simple operations. 

There are four basic classes of entities around which 
GPSS operates: (1) dynamic, (2) equipment, (3) opera- 
tional Frandwt4ytstatistical: 

The dynamic entities in GPSS are called “transac- 
tions". They are used to represent elements of the 
system which are thought of as moving through the 
system. Associated with each transaction is a set of 
parameters which can be assigned values to represent 
the characteristics of that transaction. In our model 
of DISPATCH, the CP/67 users become transactions which 
move through the operational entities (see below) that 
model the logical operation of DISPATCH. The para- 
meters of each such adadsacinon are used to keep 
information on the status of the corresponding user 
(e.g. USERID, runnable, unrunnable, in Qh: in Q,-WAIT, 


etc.). The movement of the user transaction through 
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the model of DISPATCH can be compared with the move- 
ment of the user's UTABLE through the real DISPATCH 
OEVCP/67% 

The equipment entities in GPSS represent elements 
of the system's equipment that are acted upon by the 
transactions. In our model the CPU, for example, 
becomes a "facility" which can be "seized" by only 
one transaction at a time. Thus the user transaction 
that is chosen to run by DISPATCH will seize the CPU. 
rhe Lengthwem time the=user has control of the CPU 
represents the time his request requires for execution 
in the real system. Besides the user transactions, 
there are two other types of transactions which can 
Gon erolrthe Crus CAPE DISPATCH* transaction has control 
during the time represented by the execution of 
DISPATCH. An "interrupt" transaction has control 
during the handling of each interrupt. The only time 
the CPU 1 ssnourunder-theveontrol, cima transaction ws 
when the idle state is entered. 

The operational entities of GPSS are called 
"blocks" and constitute the logic of the system, 
instructing the transaction where to go and what to 
do next. There are 43 distinct block types in GPSS, 


each representing some step in the operation of the 
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The functioning of GPSS is based on the entry 


of transactions into blocks and the subsequent execu- 


EVOnnOL ther GeSS  subroltine, associated .with. each, block 


type. Four basic types of events may occur within a 


block: 
a) 


b) 


G) 


Creation. or aestruction of a transaction; 
alteration of a numeric attribute of some 
entity; 

delay of a transaction for some specific 
amount of time; or 

alteration of the transaction, flow through 


the block network. 


For example, in our model the occurrence of a virtual 


interrupt during execution results in: 


a) 
b) 


c) 


d) 


the creation of an interrupt transaction; 

the user transaction is made unrunnable; 

the interrupt transaction is delayed for the 
assigned interrupt wait time (T), during which 
the user remains unrunnable; 

when time T has passed the interrupt transac- 
Lion, preempts, control of the CPU, termanating 
the current request transaction. (‘The 5 ei 

is made runnable again, the interrupt tran- 


saction is destroyed, and control returns to 


DISPATCH. ) 
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As class of entities built into GPSS is 
the statistical entities which provide the facilities 
for obtaining measurements on the behavior or perfor- 
mance of the simulated system. For example, GPSS 
"tables" were used extensively in this project to 
obtain the frequency distributions of several events 
occurring in the model. "Queues" were used to obtain 
measurements of the activity at the user queues main- 
tained by DISPATCH. 

Each movement of a transaction from block to 
block is considered by GPSS as an event which is 
scheduled to occur at some particular time. In order 
to provide the correct time sequence, GPSS maintains 
a clock of real simulated time. At each point in time 
when some event is scheduled to occur, GPSS will process 
all currently active transactions that can be moved 
into=some, next block. The clock is then updated to 
the time of the next scheduled event and, in this 
fashion, the passage of time is simulated. 

The time unit represented by the clock is selected 
by the GPSS user, depending on the objectives of the 
project and, to some extent, on the accuracy of the 
input data. In this model, the unit chosen was one 
msec. It was felt that a unit of this size was necessary 


to model the operation of the system in sufficient detail, 
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even though some of the input data was based on 
samples taken every 100 msec. (or .1 sec.). 

Pid. 65 soveelugtrates the GPSS logic used to 
Simulate the flow of a user's requests through CP/67, 
(For further information on the input requirements and 
program parameters see Appendix C, and for program 
listing contact the Department of Computing Science 
Taibrary-at the Upot A.) The logic used to simulate the 
operation of DISPATCH is, of course, the same as that 
of the real system as described in Chapter IV. The 
following simplifications were made however. 

a) There was no distinction made between types 

of interrupts. For example, the user was not 
put in IOWAIT or PAGEWAIT; rather, he was made 
either runnable or unrunnable. Although the 
emuctalereason Lor not Ssimulatang the types 
Olpinterrupts=wacseene Vack Ofeaccurate datay 
it was felt that such detail was not necessary 
WHUineathe-objgectives, of the; project. The 
important consideration was accurate repre= 
sentation of the virtual interrupts and their 
infiuerce on tEhe™-operetion of DISPATCH. 

b) ASmawdimect result of] the firstisamplitication, 

the operation of DISPATCH did not include the 
examination for CPRQUEST, or for PENDING 


interrupts. 
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Fig. 5.3 GPSS User Model 
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c) In the real system, a user in execution is 
put in CFWAIT each time a response is 
required from the terminal. A user found 
in CFWAIT is considered interactive and is 
put in Q,-WAIT (giving him the fastest possible 
attention when the terminal response is received). 
Since the signal to terminate the CFWAIT con- 
dition is from the terminal hardware itself, 
not from the user, and since the data collected 
was not able to distinguish between these two 
Signals, the requests modeled likewise do not 
make this distinction. A new request is 
defined each time a user enters Q,-WAIT, 
regardless of whether it is entered from 


CFWAIT or WAIT (i.e. an actual user request). 


2 The Measurement Technique 


As stated earlier, the technique used to collect 
data from the CP/67 system is an extension of the method 
developed by A. Gatha [15] in an earlier evaluation 
study of the U of A installation. The method involves 
using a. CMS virtual machine which is. able to read 
information from the CP/67 nucleus. It is a sampling 
technique in which the relevant data is obtained at 


certain. short. time antervaLls.- The method. adds. no 
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measurable overhead to the operation of CP/67 since the 
data gathering program is just another normal CMS 
program. Its operation is designed to take advantage 
ofthe time-sharing nature of ‘the system to provide 

the repeated bursts of execution necessary to obtain 
the proper sampling. 

There are two qualifications to make on the term 
"normal CMS program" used above, since the virtual 
machine used (CPSTATS) is privileged in two respects. 
First, it was given a privileged priority class which 
enables CPSTATS to execute the "diagnose" privileged 
INSstructron- (DITAG)*. (All these programs are in 
360/Assembler language.) The DIAG instruction allows 
the user to read values from specified locations within 
the CP/67 supervisor. 

Seconda, —CPSTATS 1s privileged by the addition 
of a "real" timer. This is an important extension of 
the basic method used by Gatha, since it allowed the 
author to develop a program which would collect data 
samples at considerably smaller time intervals. The 
normal CMS user receives a timer interrupt after every 
2 sec. of execution time. This timer interrupt is 
virtual; that is; the timer anterrupt is simulated by 
CP/67 each time it finds that a user has used an 


auaittional 2 Sec. of VIOTTIME. The virtual machine 
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does not "receive" the interrupt until it is chosen 
£6 Lun agains Plkeetrealutiner in CPSTATS ,ishalso 
virtual; however the time used by CP/67 to calculate 
the passage of time between interrupts consists, not 
only of CPSTATS's VTOTTIME, but also the time spent 
by®CPSTATS®in WAITOstate:s Thushit does\in; fact: repre- 
sent all real time for that virtual machine. CPSTATS 
must still wait its turn before it can process the 
interrupt. (These two privileged conditions exist 
within CP/67 and can be implemented by specifying, 
at system generation time, that the virtual machine 
has these capabilities.) 

In the next section the basic logic of the data 
gathering package is discussed. Following this the 


specific data collected will be described. 


Zl LOdran OG 1C 


The first important consideration in developing 
the program logic was how to control the time inter- 
vals at which data samples would be taken. An interval 
of .1 sec. was deemed necessary to provide sufficient 
information for describing the user being "followed". 
Implementation of the "real" timer gave the control 
that was needed. In a normal CMS virtual machine a 


timer interrupt merely produces a "blip" at the user's 
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terminal, and does not otherwise affect the execution 
of the user's present request. In CPSTATS, the data 
gathering routines are inserted into the CMS external 
interrupt handler (EXTINT), and each time CPSTATS 
receives a timer interrupt these routines are executed. 
The interrupt interval (in EXTINT) is altered from the 
normal 2 sec. to provide an interrupt approximately 
every .1 sec. real time. 

Initiating each data collection run involves 
specifying the USERID of the user to be followed that 
day (OURMAN), and altering CPSTATS's EXTINT routine 
POmIncrhude branche LOmc he actual deta gathering programs 
as well as to insert the new interrupt time interval. 
Once EXTINT has been altered, the collection of data 
automatically begins with the first timer interrupt. 
Eiiuich wOtUmeng mime daca COLLeCtLOnNe run, the CPSTATS virtual 
Machine is not doing any work other than receiving timer 
interrupts and executing the altered version of EXTINT. 

There are two routines associated with the col- 
léction of data™ The first (WALTEST) receives contro. 
from EXTINT and performs a preliminary examination of 
OURMAN to determine if his status has ETS since 
the last search and, if not, whether the last data 
record should be saved. ‘The second routine (UDATA) is 


then given. control and» peritorms the actual data 
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CollectiommsCOntsuor i.Sathen.~returnedutorBXTINT.and 
CPSTATS GnteesculLneawALlLlsasStarcetonawaltrther nextatimer 


interrupt. 


WAITEST 


Two considerations were involved in the develop- 

ment of WAITEST. 

a) With data being collected every .1 sec. on 
the average, the accumulated volume of data 
becomes very large and provisions had to be 
made _to store it. 

b) Any data taken while OURMAN is inactive (i.e. 
thinking) yields no useful information, since 
he is representing no new input to the system. 

WAITEST is thus designed to save only that data which 
represents the user's periods of activity. The data 
collected is in a condensed form eliminating the excess 
bulk of repetitive records, and allowing a longer 
collection: period. 

WAITEST operates in the following manner. 

a) The address of OURMAN's UTABLE is found by 
searching down the NEXTUSER chain of UTABLEs, 
using the DIAG instruction. (At this stage 
WAITEST will also detect if OURMAN has signed 
Obb and, 41 550, the data ‘gathering run is 


terminated. ) 
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b) When OURMAN has been found, WAITEST gathers 
sera Die information from his UTABLE and 
performs an initial examination. 

i) If OURMAN is in WAIT, and has been 
since the last examination, the 
output buffer pointer used by UDATA 
(see below) is moved back so that 
the data record obtained in the 
previous search will be overwritten. 

Lie et eeOURMAN IT SinOt dn WALT, .Or if .he 
has executed since the last examina- 
tion, the buffer pointer is not moved 
back and control is transferred 
directly to UDATA. This time the 
data from the previous search is 
Savedwandstieacurrent Catayis placed 


Turtle mex tLbUELeCr -LOoCcation. 


The effect of WAITEST's operation is that the data 
collected produces a series of "Snapshot" descriptions 
of OURMAN. Each time OURMAN is active, data samples 
are obtained with each interrupt. When he is inactive 
for more than two searches there is a corresponding gap 
in the data. A count is maintained of the. number of 


searches "lost" during each inactive period. 
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UDATA 


The function of UDATA is simply to collect the 
specified data each time it is entered. The major 
consideration is the storing of the data. Each time 
it executes, UDATA withdraws 64 bytes of raw data from 
the CP/67 nucleus. UDATA provides an 800 byte buffer 
area within itself for temporary data storage. As 
data is put into the buffer, a pointer is advanced 
so that information is not overwritten, unless WAITEST 
deliberately moves the pointer back. After the data 
“Le collected, “controle ts*returned-to EXTINT* 

Two conditions may alter UDATA's basic opera- 
HiL.oN. 

a) If the pointer moves beyond. the 800 byte 

butter limit,,meaning,.the buffer is full, 
the -data in the buffer is transferred to 
intermediate disk storage. 

b) Liyewhiens ches butter. is.read, out onto,disk, 

the intermediate storage area also becomes 
full (see below), then the data gathering 


LUN se terminated. 


The size of the CPSTATS virtual machine is defined 
to be 896 records of 800 bytes each. Since some of this 


space is required to contain the data gathering package 
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itself, a limit of 800 records was set aside for inter- 
mediate storage of data. When this space is full, the 
data gathering run must terminate. 
A data gathering run is terminated in one of 
three ways: 
a) WAITEST automatically terminates when it 
finds that OURMAN has signed off; 
b) UDATA automatically terminates when inter- 
mediate storage is filled; and 
c) the CPSTATS user can terminate the run at 
any time by issuing the CMS "kill execution" 


(kx) command at the terminal. 


When a run is terminated, another program (ANUSER) is 
executed which takes the raw data, which is in binary 
form, from intermediate disk storage, edits it for the 
desired information, converts this to decimal, and then 
punches it out on cards. For each recorded search, me card is 
punched. JWhen therdata has been transferred to pexr- 
manent storage (i.e. cards), the intermediate storage 
can be cleared for the next run: 

The amount of data produced during one run will 
depend on the length of that run and the activity of 
OURMAN. Since a user who is active 100% of the time 
will produce 64 bytes (and 1 card) of data 


G@ach..>1 sec. , one buffer (800 bytes) will hold the 
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results of 12 searches or 1.2 sec., and intermediate 
SLOLage Wire enOorar7o0"secs = (1G min.) "or*data. Hence 
the data gathering could be as’short as 16 min. and 
could produce as many as 9600 cards. The average, 
however, was about one hour, with about 5500 cards 


being produced. 


Zoeaecne DatavCollected 


Bach search of UDATA produces a complete set of 
the variables listed below. ‘The significance oGweach 
variable is given where it is felt necessary. Many have 
already been introduced. Most of the variables used as 
data already existed within the CP/67 system; however 
a few had to be added especially for this project. 

Such variables are marked with an (*). 
The following variables were obtained from OURMAN's 
UTABLE. 
a) VMSTATUS indicates whether or not OURMAN is 
in either PAGEWAIT, IOWAIT, or CFWAIT. 

b) TIMINQ indicates whether or not OURMAN is in 
avqueue grand 7,15, so;sinjiwhichs»queue. If he 
is in a queue, TIMINQ contains his TIMEUSED 
atethe time he entersdethat pqueue. 1Byecom= 
paring this value with his present TIMEUSED, 
it can be determined how long he has been in 
that queue. Also, TIMINQ contains the NOQUANT 


value of OURMAN. 
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VPSW indicates whether or not OURMAN's 
virtual machine is in WAIT state. 

VTOTTIME indicates how much time the 
virtual machine has spent in actual 
execution. The size of a request can 

be determined by examining the before- 
and=at ter values or VTOTTIME. 

USERINTD (*) indicates how many times 
OURMAN has been interrupted while executing. 
USERGO (*) indicates how many times OURMAN 
was interrupted while executing but was 
chosen to run again immediately (Choice 1; 
seeeChapter IV, Sec. 4.2.1.2)... .The 
difference between USERINTD and USERGO 
gives us the number of times OURMAN could 
not run again immediately because he was 
unrunnable. Hence we know how many virtual 
interrupts he has caused. 

INTPTIME (*) indicates the amount of TIMEUSED 
which has been charged to OURMAN, by CP/67, 
for handling his virtual interrupts. 
NUMPAGES indicates the number of pages OURMAN 
has in core at the present time. (This value 
was taken for interest sake and was not used 


in the simulation study.) 
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The following variables are system parameters 


obtained from fixed locations in the CP/67 nucleus. 


i) HOURS indicates the real time of day in 
hours, minutes, and seconds. It is used 
to measure time intervals which exceed 
one second in length. For time intervals 
in the neighbourhood of one second or less, 
the length of the interval is measured by 
the number of searches involved, assuming 
each search. 1s. equal. to ).1. sec. 

}) TIMEUSED. 

k) OVERHEAD. 

1) ee CPTIME. 

m) WAITTIME. 

n) DISPENT (*) indicates the number of times 
DISPATCH was entered after finding and 


executing a CPRQUEST. 
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o) DISPENT+4 (*) indicates the number of times 


DISPATCH was entered normally - after a 
virtual machine had been executing. 

p) DISPENT+8 (*) indicates the number of times 
DISPATCH was entered from WAIT state. The 
sum of the last three entries yields the 


total number of times DISPATCH was’ entered. 
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In addition: 

gq) WAITCNT indicates the number of searches 
"lost" since the last active period of 
OURMAN. This contains a value only for 
the first search of a new request. It 
PesUeecdslOrcalculatve: Lhe Tength of the 
preceding think time where this interval 
is less than one second. Otherwise HOURS 


is used. 


This concludes the description of the simulation 
model and the measurement technique used in this 
project. The next chapter discusses the results 
obtained from the data gathered and from the operation 


On the simulation model : 
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CHAPTER VI 
RESULTS 


Measurements were taken over a 6 week period of 
Eanesauring March and April, 1970. During that time 
CP/67 ran 3% hours a day, except Sunday, between the 
Revco Omra soma LOnaorasti.. ~Data was, taken only. on 
weekdays and generally after 9 a.m., when a "normal" 
load was considered to exist on the system. To 
determine what constituted a normal load, a rough 
Survey was taken over the duration ae EneGlOa tancol lece 
tion period. The survey showed a minimum of 5 users 
on the system and a maximum of 16 users, with the 
average being about 10 at the beginning of the tests 
and increasing to approximately 13 near the end of the 
bests. 

On any time-sharing system it is impossible to 
define a normal load, since users are continually sign- 
ing on and off. Also each user may represent an entirely 
different load to the system. For example, the figures 
given above include such users as CPSTATS, APL, and 
OPER (the operator) which would probably be considered 
unusual in any definition of normal. 

A total of 14 users were followed for the purpose 
of obtaining representative data for input to the simu- 


lation model. The users chosen were picked arbitrarily 
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from among those signed on. Although there were close 
to 100 registered®CMS users at the: U of A, only 20-30 
were active to any extent, and efforts were made to 
follow users who were recognized as common users of 
GP/6U4 

A follow-up survey was taken of each user on the 
day he was observed. Results showed that these users 
were signed on for an average of about 1 hr. and 20 min. 
During their terminal session they used an average of 
about! lomins 10’ secs execution time (VTOTTIME) but) were 
Chabg cdefoOraapouta2amantei5osec.t (TAMEUSED)SenThe ratio 
GOESLIMEUSED tosaVLOUTIME wastaboutt2e1< ti&haustratio 
appeared to be directly proportional to the amount of 
I/O conducted during the terminal session. It ranged 
SEO 1s tet Ocaaycomprte—boundtuser ,?to 42721 forwan 
I/O bound user. (The more interrupts a user caused, the 
more work that must be done by CP/67 to handle them, and 
hence the I/O user was charged more.) 

In addition to the 14 (normal CP/67) users followed 
for data collection purposes, a run was made on each of 
APL and CPSTATS. During the data’collection period, 

APL was used on a limited basis in conjunction with 
CP/67. Although APL is considered a single virtual 
machinepby&€P/677OLt.is;iin facts vaitime-sharing’ system 


in itself which can handle many users on this single 
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machine. Although it only had 3 users signed on, results 
of the APL run showed it to be a very heavy user of 
computer time. During the 11 min. 13 sec. of data 
Collect: on, Aes sea 7 min. 26 sec. of VIOTTIME,, or 66% 
of the CPU time available! (It is thought that the APL 
users were probably taking advantage of the low usage of 
APL on CP/67 to execute large programs resulting in the 
heavy computing load.) Because of the unusual nature of 
Bho sArEsuser,eand the heavy load it represented, the data 
obtained from it was not considered as representing normal 
CP/67 user input and therefore it was not used. 

A run was made on CPSTATS itself to determine how 
much load the data gathering machine was imposing on the 
syvsctema) sDuiing szhesl6- min. 14.sec..(774.-sec.). run, 
GPSTATS was charged with 23 sec.. of TIMEUSED, of which 
meceCC Ww aSc eVylO LIME g— aGatio. Ob +4,.601L..4 The »Z23 Sec. .repre- 
sented 2.3% of the CPU time available during the period. 
The 5 sec. VIOTTIME alone represented only %%. The high 
PIMBUSED. £0, VIOTTEIME sratio indicated. that..a good ideal of 
the load from CPSTATS is I/O, which was the movement of 
data into intermediate disk storage. Since there were 
10,561 searches made, each one involved an average of 
about 2.2 msec... of .TIMEUSED... CPSTATS occupied between 
Seto .Gpages eile cOLes slhie. was sabout 035..0f 4 ;totea).oF 


192 pages. Gf ,core, storage, avai lable.at \the UofA. 
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1 Measurement.Results 


A Fortran program was written which analyzed the 
data collected. The results of each sample were compiled 
into cumulative tables using APL. The results of the 
analysis are presented in this section. 

The 14 users were followed for an average of 54 
Min. Cac.) 1n!s Involved a total of 457,331 searches 
for an average of one search every .10 sec. as desired. 
Among individual samples this figure varied from .07 sec. 


£0. L6 sec: 


Lou LUuSer Description 
Del.> Reeuest GizecDrstributzon 


A total of 12465 user requests were recorded. 
Table 6-1 classifies these requests by user and by size. 
The intervals used to classify the requests by size were 
based on the operation of the real clock in the 360/67 
which increments by one every 3.3 msec. Hence the 
smallest measurable time increment was approximately 
Ss msec. It was found that 5577, or 44.7%, of all requests 
were under 3 msec. in size, 3598, or 28.9%, were between 
3 and 6 msec., and so on (see Table 6-1). 

Table 6-2 gives the cumulative distribution of 
request sizes for all users as taken from Table 6-1. 


From this a classification of interactive and heavy 
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(compute-bound) users was made. Interactive users were 
defined to be those users for which 85% of their requests 
were less than 9 msec. This included 7, or 50%, of the 


Gnserved Wsseran lisers, no. 2h 3m di, 85 lO jp 234 cands 14). 





Heavy users were defined as those with approximately 30% 
of their requests over 50 msec. This included 2 of the 
Users, nemely no. 1] and 12. 

Table 6-3 is obtained from Table 6-2 by averaging 
the interactive and heavy users and thus shows the three 
request size distributions as they were inserted into 
the simulation model. A normal user is defined by the 
distribution obtained over all 14 samples. The maximum 
request size put. into the simulation model was 12 sec. 
The 16 overflow requests (over 5 sec. in sizé) recorded 
averaged a little over 8 sec. each. The highest value 
found was given by user no. 4 whose 3 overflow requests 
averaged 14.5 sec. each. 

Beetougiimo ce OL wiv requests: were 1éss than 39 meece, 
the average over all requests measured was 46 msec. 
(The midpoint of each interval was used in this calcu- 


lation. ) 
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Table 6-4 gives the frequency distribution of the 


think time values found for the (12465) requests recorded. 
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4365 were recorded to be less than 1 sec., 2629 were 
registered as being 1 sec. in length, 1590 as 2 sec., 

and so on. Because this table was obtained using the 
HOURS value (in seconds) taken in each data sample, the 
first two interval readings are not sufficiently accurate. 
Por qreatemmaccuzaecy,,ci,4 the Ofand. lL isec. “intervals, a 
separate count was kept of the number of searches 
involved. Of the 6994 values involved in these two 
intervals (see Table 6-5), 3812 were recorded as being 
less than search or .! sec. , 69rwerealess than .«2 sec., 
and so on.) Vatues. of 10 searches or more were grouped 
together as being 1 sec. 

DablesG—5 twaseusedetorconrect tthesfixrst twos inter- 
vals of Table 6-4, and the combined result yielded the 
cumulative distribution over all requests as shown in 
Table 6-6. Similar distributions were obtained for 
interactive and heavy users alone. An average think. 


time of 3 sec. was obtained over all requests. 


Te) Leer Bp LitkenaGGiVvale lieu bDoa Str iLbublon 


The interarrival rate of virtual interrupts within 
a request was derived from Table 6-7 which classifies 
the interrupts according to the time interval in which 
they occurred. These figures include,the (12465) inter- 


rupts caused by the completion of each request. In 
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Table 6-8, these completion interrupts were removed to 
obtain the frequency Pee interrupts within each 
interval. For example, of the 20,041 interrupts recorded 
in the first 3 msec. of all requests, 5577 were attributed 
to the requests which completed during this time (see 
lovlewG- Ll) meline meant thal 14,464 interrupts, or 29.7% 
Ofvall@vi ritual interrupts, occurred within the first 
Semsec., OF the requests. Furthermore, 0.5% of all virtual 
interrupts occurred between 3 and 6 msec. of those requests 
which were more than 3 msec. in size, and so on. 

Notice that the Mreequenties, dO 10 Give ytne lstri 
bution for the interarrival time between two interrupts. 
Rather it gives the time within a PeqQuesteehatewiemne .c 
interrupt is likely to occur given the amount of time 
Pivatrebecuucceeias already Executed. “In Other words, given 
that a request has already executed 3 msec., there is a 
Oem POLS OULG vetieot ete Next Interrupt witl OCCUr Li 
ties co Oo Msec. Louterval. 

the cumulative distribution is given in Table 6-9, 
along with those calculated separately for interactive 
and heavy users. From Table 6-9 a distribution of inter- 
arrival times its Joon two interrupts was calculated, which 
was used as input to the simulation model. This was done 
by generating a number of interrupts, using Table 6-9, at 


the beginning of each request. These interrupts were 
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stacked according to their predicted occurrence time. 
When another interrupt was required, the next interrupt 
was taken from the stack and the (interarrival) time 


until its occurrence was, calculated. 


Preece I NCerrupeswalt ime DiStri bution 


The sampling technique used to collect data (every 
2 )5eC-)) was not adequate to Obtain an accurate descrip- 
tion of the interrupts and the time necessary to process 
them. The data obtained showed only that 99% of all 
interrupts were processed in under 2 searches (.2 msec.). 

in bieus of, adequate data, an exponential distribu- 
tion with a mean of 10 msec. was used to describe the 
interrupt wait time. This distribution was stretched 
Past nes Joes point, slo, a maximum wait time of 1 sec. 
(Thus the mean was slightly over 10 msec.) This was done 
LOwawlOw PLOG ene, Occurrence (Of a Lew large D/OMintexrcuptcs. 
The maximum wait found in the data was one of 15 searches. 

The 10 msec. mean was actually considered to be a 
high estimate but was used as a worst case figure. 
However as the number of users increased, it was thought 
that the 10 msec. figure would become more reasonable 
Since the chances of more conflicts between interrupts 
would rise resulting in longer waits. Also a greater 
percentage of interrupts would be due to paging and the 
average paging operation (from the drum) requires about 


12 msec. 
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ie2enSystem Description 


To model the load caused by the operation of the 
CP/67 system, it was necessary, and sufficient, to 
obtain data on the CPTIME used. Three separate time 
increments made up the total CPTIME (see Chapter TUT 
Pid@eme)) see lie ct hestewas Lhe portion of TIMEUSED which 
was charged to a user for processing each virtual inter- 
rupt. For the 61104 interrupts recorded over all samples, 
a total of 338009 msec. of TIMEUSED was charged. This 
averages 5.5 msec. per interrupt; between individual 
samples the average ranged between 3.2 and 8.2 msec. 
Pecovstentavallcwor 5 ensec,, was pul into the simulation 
model. 

The second value needed was the portion of TIMEUSED 
which was charged to a user within DISPATCH. A value of 
.002 msec. was put into the simulation model. This means 
tiat7;. On the average, -002 msec. TIMEUSED was charged to 
each user each time DISPATCH was executed. This approxi- 
mate figure was obtained from the data by calculating the 
total TIMEUSED charged within DISPATCH over all samples 
and dividing this by both the number of entries into 
DISPATCH and the average number of users. 

The third value needed was the OVERHEAD charged 
each time DISPATCH was executed. A value of .08 msec. 


Wass OUGeLotGe vices imularc tom model to represent the: time 
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taken by DISPATCH to examine one user during it's search 
for a new user to execute. Again this was an approximate 
value .calculated, from the data by dividing,the, total 
OVERHEAD used over all samples by both the number of 


entries into DISPATCH and the average number of users. 


Wes. DiscussionsofsResults 


An obvious fact which emerges from examination of 
the measurement results is the dependence of the precise- 
ness of the data upon the measurement technique and the 
data available within this technique. In particular, 
this refers to the difficulty of obtaining accurate 
measurements of small time increments which, in most cases, 
are the essential quantity being measured. In the four 
dicerabutionssdivensabove, the.situation,.becomes.progres— 
Sively worse until, with the interrupt wait time distri- 
bution; the.data, provided very. little .information....The 
.l1 sec. sampling interval proved to be very inadequate in 
this case. Even where the .1 sec. was felt to be sufficient, 
AaASweiNethe, request Sizevdistribucion, 2hes preci cenesosot atic 
data became dependent on the data available (i.e. the fact 
that requests of less than 3 msec. remained unmeasured 
even within the system). However since there is always 
a trade-off between the sampling interval and the amount 


SCtedata collected, at wasafelt that the..l.sec. interval 
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was adequate. In particular, the data collected accom- 
plished its purpose of providing some reasonable and 
realistic description of the system where no such infor- 


mation, in any detail, was previously available. 


Zeeoimltatvon RecvulLes 


ave ekUnIIng.. iment or cimuUlation 


First concern in the operation of the model was 
the question of 1) the rate of applying the load to the 
system during the warmup time, and 2) the running time 


necessary to collect reliable statistics. Early runs 





of the model showed that the average interarrival time 
of requests for service was consistently less than 200 
msec. and decreased (to less than 150 msec.) as the 
number of users increased. Hence users were introduced 
into the model at a constant rate of one every 200 msec. 
The object was not to create any unusual loading condi- 
tions by introducing the users too rapidly. The warmup 
time was set at 10 sec. This should allow each user to 
complete at least one request and to pick the arrival 
time of his next request. After 10 sec., the requests 
should be entering the system at a normal (random) rate. 
The large amount of computer time required to run 
the model prevented simulation of large time intervals. 


The aim, then, was to simulate only long enough so that 


a 4 
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early extreme fluctuations from the random number generator 
would stabilize. DULitig™a 2 mil. run, sample statistics 

on the system's operation (particularly the average request 
Size) were taken every 5 sec. On the basis of these 

samples, it was decided that 30 sec. of running time was 
sufficient to achieve this objective. The final results 

of the’ simulation model, then, are based on a simulated run 
oie 30Ssee. STo simulate! 252 normal’ users’ for *this® 30sec. 
required between 9 and 10 min. of computer time. Fewer users 
required less computer time. For example, 12 normal users 


only required 2.5 min. of computer time. 


2.2 Validation of the Simulation Model 

As in any simulation project, there remains the final 
step of model validation before the results from the simu- 
lation model can be considered reliable and useful. Of all 
the problems associated with computer simulation, that of 
verifying the simulation model is perhaps most elusive [24]. 
Some of the problems encountered in this project are dis- 
cussed in Sec. 2.4. 

in vaddition, to the CPU utilization figures (WATT TINE: 
OPTEIME, -and PROBEIME):, -the two watio0s or CePeIME sco 
PROBTIME (CP/PROB) and TIMEUSED to PROBTIME (TU/PROB) 
were used in comparing the operation of the DISPATCH 
model with that of the real system. These last two values 
were used since they reflect chat batt -o1 the total@system 
operation for which DISPATCH is responsible. The CP/PROB 
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2-2-1 Data Used for Validation 

Table 6-10 gives some of the overall results observed 
in the measurement data that were used for validation of 
the model. The table summarizes the number of users, 
WAITTIME, CPTIME, PROBTIME, -CP/PROB ratio, and the TU/PROB 
ratio for each of the 14 measurement samples as well as the 
overall averages. The table shows a lot of variation with 
the number of users varying from 5 to 15, the WAITTIME etm 
0.8% to 91.8%, CPTIME!)£rom 5.88 tor 1927) PROBTLIME -from.2. 4% 
BOES S205 pC AEROPSFat10O.from .4 to 3.9 and the TU/PROB ratio 
Prone: @GOm ft eerre Ce 7 PROBTYatTOrolo.o and a TU/PROB ratio 
of 5.4 indicates that for each second spent in problem mode, 
the system uses 3.9 seconds for overhead (CPTIME), and wee 
user is charged for 5.4 seconds (TIMEUSED). In the overall 
average the total time was divided approximately equally 
between. the chree goimes @(WALT,. CP, PROBTIME). The overall 
CP/PROB and TU/PROB ratios were 1.1 and 1.8, respectively. 

Of particular interest is the seven samples with 
higneePpUsutisi zation. (ise. WALITTIMEgless than 163), 
Ssaincesthese samples (no¥ 1,'3, 5,}.8,, 10, 11, 12) represent 
the system under loaded conditions. Although all these 
runs have at least 11 users, their average is only 12.1 
as compared to the’ overall average of 10.7. Thus the 
number of users is not a good indication of the load on 
the system, unless there is some knowledge of the nature 


of the input these users are representing. 
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This is also illustrated by examining the wide 
variation of the CP/PROB ratio within these seven 
samples. The CP/PROB ratio ranged from .6 to 3.9, 
aimmost the full. “ange found over all samples. *This 
indicates that the input which was represented by the 
Mecroemrecheoc acamples drifered significantly although 
they all produced a loaded condition in the system. 

The high CP/PROB ratio probably resulted from a large 
number of interactive users, or those requiring large 
amounts of paging, whereas more compute-bound users would 
result in the lower CP/PROB ratios. 

The TU/PROB ratio for these samples varies over 
the entire range with an average of 1.5 compared to 
the overall average of 1.8. The wide variation in 
TU/PROB is probably caused by large variations in the 
amount of I/O the users are doing - high ratios from 
heavy I/O. 

Since knowledge of the user input is such a vital 
consideration, ra teyuttexe method of validating the simulation 
model is to set up a controlled load situation in which 
one knows exactly what each user is doing. Such an experi- 
ment was developed by G. Neufeld [25] for CP/67. In this 
experiment each test user was executing an identical 
program involving continuous matrix multiplications with 


a controlled amount of paging. System load was controlled 
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by increasing the number of test users. Using this 
experiment, additional test measurements were made on 

the CP/67 system in an attempt to obtain figures with 
which to validate performance of the model and, at the 
same time, examine performance of the system under a 
controlled load situation. The results obtained are 
illustrated in Big. 6.1. (It should be stressed that 
these users are each equivalent to approximately 5 normal 
users.) 

Best performance is, of course, indicated with one 
user. At 3 users, the observed response dropped notice- 
ably although performance was still acceptable. The 
CP/PROB ratio was .57. However the user followed (which 
was typical of all other users) was found to be in 
PAGEWAIT 40% of the time. At 5 users the performance 
of the system was extremely poor; the CP/PROB ratio 
jumped to 3.5 and the user followed was in PAGEWAIT 83% 
of the time. At 7 users the system was barely responding. 
Only 4% of the time was spent in problem state. The 
CP/PROB ratio leaped to 13.5. WAITTIME increased while 
PAGEWAIT time decreased indicating such severe conjestion 
that the user was not being served enough to even demand 
pages. (The system is thrashing, a condition discussed 
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Fig. 6.1 Controlled Test Load Results 
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Zutwe Se BVOLULION OL the Simulation Model 


Although problems were found in comparing load 
conditions (and hence performance) between the model and 
the real system, the model showed it's flexibility in ene 
ability to be adapted to give the desired performance for 
a given load. Thus, once agreement on a load definition 
is reached, the model can be adjusted such that it's 
performance will match that of the real system under the 
same load. 

For example, in the process of validating the model, 
many tests and alterations were made. Initial runs of 
the model were able to handle up to 31 users with no Ars 


of overloading, as the following performance figures 


pivustrate’ 


Response 





The model was then changed by making the number of 


interrupts generated a function of the number of users 

on the system. A multiplication factor of eer was added 
to the number of interrupts assigned a request, where N is 
the number of users. The number 15 was arbitrarily chosen 
as the "loading point" since it appeared to be the point 


at which serious conjestion began to occur in the paging 
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activity of the system. (A lower figure could be used 
to indicate larger program sizes.) The results of this 


change were as follows. 


With 23 users: 


AVe~ReC. 
Size (msec) 






Response 
Request 


With 26 users: 


DV.CTRCO 
Size (msec) 


Response 


6 WAIT Request 


Although the increased number of interrupts brought the 


CP/PROB and TU/PROB ratios up to a realistic level, the 
response time indicated that the system was still under- 
loaded with 26 users. 

The model was again altered to allow more than one 
interrupt at the same time. Previously, duplicate inter- 
rupts (generated to occur a the same time within a 
request) were discarded. It was felt that this change 
Significantly improved the model which now gave the 


following results. 


With 23 users: 






AVE.sLesp. 
Size (msec)|Ave.req. 
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Reaction of the model under load was now reflected in 
the response time. A final change was made in an 
attempt to increase the WAITTIME since it was now con- 
Sidered too high as compared with the results of the 
test@loademeasunementsd(Figsnd. d);: 

To increase the WAITTIME, the interrupt wait time 
was increased. The same (Fe malbiphneation ,.factor 
was used in increasing the time required to process each 
interrupt. The 15 user "loading" point was used again 
for the reason given before and also since it is at this 
point that CP/67 would normally start using the disk for 
peding wathus@resw! tingsin Longerspage transfer times. 
(aawneehrcamuLesp) Icatbonsnaceor 1S arbitrary and could 
easily be altered to reflect either more or less conjes- 
Clon asa ttinccron Or tne number“of users?)>. The°’résults 


of this change are shown below. 


WULDE2oeUsers: 





At this point, the performance of the model was 
considered to be a good approximation of the performance 
of the real system as was measured in the data. (Compari- 
son of the model results with the measurement results is 


contained in the following section.) 
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The flexibility of the model was thus illustrated. 
The model can be adapted to yield the desired performance 
given a defined load. The model was equally as flexible in its 
ability to define different’ input conditions to obtain 
the desired load. By defining users as normal, interactive, 
and heavy, the model was able to alter the request size 
distribution and the arrival rate of requests. Interactive 
users have smaller requestswith larger think times (see 
Tables 6-3 and 6-6), while heavy users have larger requests 
with smaller think times. The number of users in each of 


the three classes can be varied to fit the desired load. 


2.4.58 Resitics Lrom the Model and Validation 


Table 6-11 gives the results of some runs of the 
model in which the number and class of users were varied 
to obtain different load conditions. Table 6-12 summarizes 
the results of all the measurement data obtained and can 
be used for comparison with Table 6-11. For the reasons 
given in Sec. 2.4, response time measured in the data was 
not used for comparison purposes. 

Lhe Lixrst fourrrowaeor, Tapler6—1i 
and Fig. 6.2 show the performance of the model as the 
load (no. of users) increases. Model performance at 12 
and 15 users is very close to that given by the average 
obtained over the 7 light load samples of the initial measure- 
ment data (see Fig.6.3). The 12 user level was used as a com- 


parison point since it was considered to be the approximate 
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TABLE 6-11 MODEL RESULTS 


Ave.Req. | Response 
WAIT| @ CP| % PROB) CP/PROB| TU/PROB| Size (msec) Request 
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average number of users on the system when the measure- 
ment figures were obtained. The response time at 12 

and 15 users indicates that the model is not heavily 
loaded. Furthermore, model performance at 20 and nS) 
users is very close to that given by the average obtained 
over the 7 loaded samples (see Fig. 6.4). 

Figures on the model's performance at heavier loads 
also rose in agreement with the measurement figures found 
in the controlled test load situation, although without 
the extreme values. The model at 20 and 23 users appears 
COM eLLte INetiesj-ouser range of the test load users. 

The two model runs marked with an * were run using a 
different random number generator with which to select 
the request sizes. The result was a much lower average 
request size which put a highly interactive load on the 
system. The corresponding poor performance figures show 
how the extreme values seen in the measurement data can 
also be reached with the model. The 20 normal * users 
correspond to the 5 test load users. 

Further sample runs are romended ins Table 6—=1 ror 
comparison purposes. For example, 15 normal and 5 heavy 
users correspond to sample no. 11 in Table 6-11 and 
illustrate how the load can be adjusted to obtain the 


extremely low WAITTIME figures seen in the data. 
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The random number generator is still making com- 
parison difficult. From observing the results and from 
experimenting with the model, it can be seen that both 
the CP/PROB and TU/PROB ratios are functions of the 
request size (i.e. functions of the ratio of interactive 
to computing requests). However the author is quite 
confident that if the average measured reguest size of 
46 msec were Simulated, the CP/PROB and TU/PROB would 
be in very close agreement with the overall averaged 


Mensuneds restless (see Fig.96.5 and 6.6).,. 


Examination of Table 6-11 also reveals some inter- 
esting conclusions. In particular, it would appear that 
although a time-sharing system is designed for interactive 
use, it is desirable to have some heavy user background 
load. For example, comparing 15 interactive users with 
10 normal and 5 heavy users, it can be seen that the 10 
and 5 load achieves both better utilization of the 
processor time and also a better response time. 

The model was thus considered to be a good repre- 
sentation of the real system. The model was adjusted 
such that a load of 20-23 normal users represented a 
relatively heavy load as compared with the test load 
measurements. This load was then used in further testing 


of ways to improve system performance under heavy loads. 
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2.3 Results of Model Testing 


Once satisfied that the model was in fact a good 
representation of the system, several test runs were 
executed in an effort to find ways in which system 
performance might be improved through alterations in 
the job scheduler. The first parameter tested was the 


time-slice. The following results were obtained using 


aeLOad OL 2Zoenormeaw users. 






12 msec. 
50 msec. 


500 msec. 


The figures clearly showed that the changes in the time- 
slice had no effect on the performance of the system. 

The average request size of 16 msec. would indicate that 
the load represented in these runs was highly interactive, 
Additional tests were made under extremely high compute- 
bound conditions. The following results were obtained 


with a load.of l5,heavysusers. 
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Time- Response 
slice 


PROB] CP/PROB| TU/PROB| Size (msec)} Request 


Under these load conditions, best performance is observed 


with a 500 msec. time-slice. For large requests, the 500 
msec. time-slice creates less interference than the smaller 
time-slices, thus better response. The 12 msec. figures 
show some difference in performance, although the 50 msec. 
figures show little significant difference in performance 
with the 500emsec-jfigures. Thus, although a time-slice 
of 500 msec. might be recommended under heavy compute- 
bound conditions, the value of 50 msec. appears to be 
satisfactory. 

Additional measurements were made on a more normal 


load situation. The following results were obtained with 


15 normal and 5 heavy users. 
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Best response is seen with a time-slice of 12 msec. , 
(The higher request Size should not be a factor in this 
as demonstrated in the immediately preceding figures.) 
There is little significant difference between perfor- 
mance with the 50 msec. time-slice and the 500 msec. 
time-slice. The smaller time-slice appears to improve 
the response of smaller requests when they are in 
competition with large requests. Thus overall performance 
is improved. 

From these three test runs, it would be concluded 

that; 

a) the time-slice has no effect on highly inter- 
active loads. 

b) a large time-slice is recommended for heavy 
compute-bound loads. 

c) small time-slice will improve performance under 
some conditions where small requests are in 
competition with large requests. 

In general, however, it would be concluded that the time- 
slice has little effect on performance and that the 50 
msec. time-slice which presently exists is quite adequate. 

Further tests were carried out by varying the 

Maximum number of users allowed in queue. The normal 


values used in the operation of CP/67 were a maximum of 














Ef Fo ife-omit s. djiw neez ai S2enoge6m 2eaeq- 
st gp od jon bleeds Sssia Jasups1 szsdpid ent: 

— 

mmr Sait nt bsta1teanomeb én) — 

lrisoitienre eflrsil 2! sexed 

msi te sid} .coem 02 old AEWw BoOnsm oe 

3407 a + reifseme soAT sotla-omtt 


‘ 


ita to sdgsoqees ort - 


fi 
y 
| 
; 

Na) 
a) 
bh 


F q 
oe : tsdd 
iLi= : ra” (6 
Haot ovitos 
| omes apial s (d 4 
! <yROD 
; ~ 
f 1 (iene (5 
\ 
3 9foa inne 
. if jth gorstoagmos \ 


s — 
somite edd tod) Sehulotiosg od bivwow Ke , ,vevowod ,fsxansp al 






Soh. bn ponsmo210q AO #933 cpieaiaions acd! soilta r 


Ro a ade nae 





e 





13247 


9 users in Qy and 6 users in Q.- The. results of these 
tests are given below; a load of 23 normal users was again 


used. 


size AVE REG. =| KeapOnse 
0,725 % WAIT|% CP|% PROB|CP/PROB| TU/PROB|Size(msec)} Request 

















Oe- 6- |) '4.37154.8 | 30.7. 1.78 2 21.8 Bono 


6 - 6 Leeoe oles | 19. 1 2a pommel 28.6 23.5 
Geer ine nOmhot 2) 29-4 2.75 B00 Dip 29.1 


Results showed a definite improvement in the response time 
GGetie sys -ccmeatsene 6-6 level compared with the 9-6 level. 
However there was a corresponding drop in the efficiency of 
PhewCPOPUtCT I Ezat! One (t.c.. che: CP/PROB and TU/PROB ratios 
jumped). This apparent contradiction - better response 
with less time in problem mode - is probably a result of 
short requests being serviced more rapidly while the rela- 
tively few longer requests wait. Tests in the 6-3 level 
showed a reversal of the above trend with some improvement 
in CPU utilizetion and an sncrease 1n response time. see 
appears that the queue size parameters are an excellent 
means of reaching almost any desired trade-off between 


response time (service to the user) and CPU utilization. 
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Since response time must be considered the primary 
performance measure, the results would indicate that 
a lower maximum number of users allowed in Q, would 
improve the performance of the system. 

The usefulness of the simulation model has thus 
been illustrated. The model can be used as a valuable 
tool to aid in making constructive recommendations for 


improving the operation of a system. 


224 Discussion 


Although validation of the model was considered 
accomplished through the good comparisons obtained 
between the performance of the model and that of the 
real system, the project pointed out the problems 
inherent in the validation of a simulation model, par- 
ticularly that of a time-sharing computer system. These 
problems exist in 1) deriving a basis of comparison (i.e. 
defining an input load) and 2) obtaining comparative 
measurement data from the system. 

The maine difficulty in defining the sload Jon 2 
time-sharing system is derived from the difficulty of 
characterising user requests (or user input). Each 
user is working on a completely separate problem from 
all other users. Thus the load he represents to the 


system, in terms of request sizes and rate of arrival, 
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is different from all others. Also each request is 
different in terms of the number of pages required, 
the number and size of I/O operations, etc. Thus, 
in a normal situation, the input load to a time-sharing 
system is made up of a vast conglomeration of different 
user requests. To arrive at a definition of an "average" 
or "heavy" load is obviously very difficult. 

In this project, load was defined by measuring 
tie lcagerepresented by Fe common users of CP/67 and 
averaging their combined data to obtain one "normal" 
user. Because of the large volume of data that was 
necessary to get the desired measurement accuracy, 
only one user could be monitored at a time. Hence 
it was not possible to relate accurately the performance 
of the system to the total user input. Furthermore the 
grouping of the 14 users as normal, interactive, and 
heavy, and averaging over each group had the effect of 
smoothing any extreme loading conditions. Since it has 
been found (by applying a known load to the real system) 
that CP/67 is very intolerable of overloads, the effects 
of smoothing the input to the model probably increased 
it's performance significantly. 

The problems encountered in obtaining precise 
measurement data have already been introduced in Sec.1.3. 


The problem of too slow a sampling rate can be appreciated 
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from observing the large percentage of items that appear 
in the smallest time interval of Tables 6-3, 6-6, and 
6-9" = (ne distribution overs this anitial interval is 
highly significant, yet is unknown. For example, 703 

of all responses were recorded as less than one search. 
Thus all we know is that these requests received a 
response in less than 100 msec. It was for these 
reasons that the measured response time was not used 

for comparison with the model. 

Although more detailed and accurate data would 
have been preferred, it was possible to make good 
comparisons between the model and the real system with 
the data available. This could be done even when some 
parts of the system (e.g. interrupt wait time, paging), 
which were not measurable at all, fee to be allowed for 
in a somewhat arbitrary fashion. The model was able to 
achieve its objective of testing the influence of the 
pOeEceCiccUler sone tne per ormance OF the system. 

Figures from test runs showed interesting results. 
It was concluded that the time-slice of 50 msec., which 
currently exists in CP/67, was a good value to use in 
the attempt to balance the service given to interactive 


and heavy users. It was found that by lowering the 
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maximum number of users allowed in Que a better response 
time could be achieved. This is perhaps one change which 
could be recommended on the real system. The results 

also showed that some heavy background users are desirable 
to allow more efficient utilization of the CPU as compared 


with utilization under a load of highly interactive users. 
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CHAP TER? VL 
CONCLUSIONS 


In general, simulation has two main purposes. 
The first, which has been emphasized in this thesis, 
is to provide a basis for predicting how the simulated 
system will perform under varied conditions and for 
determining which conditions are necessary for optimum 
performance. 

In this respect, the project has yielded several 
interesting results concerning the operation of CP/67, 
Although CP/67 may be very useful to a relatively cen 
programmers who each require a virtual machine (e.g. to 
develop new operating systems), it appears from the 
results obtained that major improvements are necessary 
LOmIMpEOy Ctl liemce pacity. Of°CP/6/ beforelat could- handle 
the computing requirements at U of A. For instance, the 
measurement data showed that 12 to 15 users sometimes 
overloaded the system although this is a relatively 
light load. The normal capacity is believed to be about 
20 users and the system would probably be so overloaded 
with 25 users that it's response would be unacceptable. 
Furthermore, the trials with test load ee showed that 
5 special users (which are equivalent to about 20 normal 
users) overloaded the CP/67 system and 7 users put it into 


a iStace 1.rom which it cannot recover. 
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The testing which was carried out with the model 
has shown the value of simulation in analysing time- 
sharing computer systems. Results of the model showed 
that the time-slice has little effect on the performance 
of the system. Only under extreme conditions were 
differences in system performance measured as a function 
of the time-slice. It was concluded that the 50 msec. value 
which presently exists in the CP/67 system should remain, 
Since it seemed to represent a reasonable mid-point in the 
trade-off which must be considered between servicing 
interactive and heavy requests. As a result of the tests, 
it was recommended that a smaller limit should be set on 
the maximum number of users allowed in Q,- A smaller limit 
seemed to achieve better response times. The queue sizes 
were also seen to be a good means of reaching any desired 
trade-off between good response timerend good GPU sutals— 
zation. Finally, the results showed that it is desirable 
to maintain a background load of some heavy users to 
improve the efficiency of the system over a straight 
interactive load. 

Among the overall achievements attained in the 
project was the development of a sophisticated data 
gathering package with which to measure the CP/67 system. 
The technique yields much more detailed information on 


the operation and performance of the system than was 
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previously available. Along with this, an extensive 
data analysis program was developed to interpret the 
data produced and to organize the results in a format 
suitable for input to the model. 

The development of the model is, of course, 
another significant Aginetanient The model can be 
used as the basis of further research into the opera- 
iron OFLC hyour 

A second, more basic, purpose of simulation is 
ho Ss uSsecuacea learning Cool." To explain: in Chapter V 
(Sec. 1) we described a simulation model as being 
composed of two parts; a model of the input environment 
and a model of the system operation. Because a first- 
hand knowledge of the operation of a system is usually 
a prerequisite to simulating that system, it is the 
input description which becomes the focal point in the 
work involved in building a valid model. It often occurs, 
at some point in the project, that a greater knowledge of 
some aspect of the system is necessary or is uncovered. 
As such, ieee becomes a valuable learning tool, 
sane the analyst into a greater appreciation and 
understanding of the system under study. 

Realizing. this aspect of simulation, one of the 
initial reasons for undertaking a project of this nature 


was a desire to gain some insight into the operation of 
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modern computer software systems. In this respect, the 
project was an unquestionable success. As Naylor et al. 
[24] states; "The experience of designing a computer 
simulation model may be more valuable than the actual 
simulation itself". 

Many lessons were learned about the procedures 
involved in developing a simulation model. Simulation 
involves many steps: collection and analysis of data, 
development of the model, programming the model, valida- 
ting the model and analysing the simulation data to 
mention the basic ones. The greatest overall lesson 
learned was that no one step is separate from the rest, 
and that consideration of all steps must be kept in mind 
at all times. . For example, formulation of the model must 
be made on the basis of the data available which in turn 
is dependent on the method used to obtain data. Valida- 
tion of the model must be considered during collection 
of the data since validation cannot be achieved without 
adequate measurement figures. 

Also the. project pointed out the lack of a scien- 
Zi fic approach: inttheasearty olsevaluatang, compuccr 
systems. However the author feels that this is inherent 
in the very nature of the field, and is not likely to 
change significantly in the future. Each computer system 
is a complex "individual", and the evaluation of each 


must be approached individually, usually with a good deal 
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of trial-and-error methods involved. The most valuable 
prerequisite for undertaking any systems evaluation 
project is some previous experience in this area, not 
to mention some practical experience with computer 
systems. Again the author would like to list the 
experience gained in this area as one of the successes 
OlLetchis projec. 

One area in which room for possible future im- 
provements can be seen is in the methods of obtaining 
measurements from computer systems such as CP/67. 
Hopefully, as the need for methods of measuring and 
evaluating the performance of the modern complex 
computer systems has been shown, system designers will 
expend more effort into developing the means of monitor- 
ing and measuring these systems. At present, the system 
analyst is required to expend a great portion of his 
time in obtaining measurement data; the lack of adequate 
tools for measuring the system forces him to develop his 
own. 

The sampling technigue used, although adequate 
for our purposes, would not be adequate for a detailed 
analysis of a time-sharing system. Smaller sampling 
intervals may be possible but would only yield an unweldy 


volume of data. 
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There is, Of course, much room for further use 
of the model. Although some testing was done with the 
model, the project has more or less only pointed out 
how the®modelcan be used.» Purther- tests could have 
been done if more time and more computer time were 
available. The model developed however has been shown 
to be a good representation of the real system and is 
ready for further use. 

Formrutures work, the logic of the simulation 
model could be expanded to better represent the role 
of the operating system in the management of the compu- 
ter's space resources. In particular, the role of 
paging in the performance of the system should be 
investigated. This, however, would be a very involved 
undertaking, more than equivalent to this research. 

One of the prerequisites for such a study would be a 
much better method of measuring the Operacion on the 
system. 

AVCNOUGh~L te SuveLyecdi rt Leulieto eS bie load 
on a time-sharing system, the controlled test load 
‘experiment is considered as the best method available. 
Further use of the model might involve designing such 
an experiment specifically to use in comparison with the 


model. 
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In conclusion, the success of the project has 
been two-fold. A simulation model has been developed 
which can be used as a valuable tool in evaluation of 
the CP/67 time-sharing system. Also the project has 
been a valuable learning experience, both in under- 
standing the complexities of modern computer operating 
systems, and in learning the procedures, and difficulties, 


involved in simulation. 
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APPENDIX A 


CP/67 VIRTUAL ENVIRONMENT 


1 Addressing and Paging 


There are four basic tables used by CP/67 for 


addressing information. 


a) 


b) 


c) 


d) 


SEGTABLE: Each user has one segment table. 
Each entry in the segment table points to 

a corresponding page table. The address of 
SEGTABLE is kept in the UTABLE of each user. 
PAGETABLE: For each virtual page belonging 
to a user, there exists an entry.in his 
PAGETABLE. Each entry contains the real 
B0GLeSSeO1mtlate pages fit 31S in- core, and 
thesin-Ccore indicator for that page. 
SWPTABLE: Similarly for each virtual page 
belonging to a user, there exists an entry 
in his swap table. Each entry contains the 
direct access storage device (DASD) address 
of the corresponding page when it is not in 
COLeG Qe lis oUSOeCOntamorone i= tlonsia. 
indicator for thats psce. 

CORETABLE: The core table consists of an 
entry. tor.each-page of real core. ‘The 


physical location of a page in core is 
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determined by the relative position of its 
corresponding entry in the core table. 

Each entry contains a pointer to the 
SWPTABLE entry corresponding to the virtual 
page currently occupying the real page. 

As well it contains an in-transit indicator 
fom that page, a LOCK indicator and the 


UTABLE address of the page's user. 


Pig. Pact cates the mappings used between 
these tables during addressing and paging. The four 
high-order bits of an address provide a pointer to the 
appropriate page table by providing a displacement from 
the beginning of the segment table. The next eight bits 
of the address provide a displacement from the beginning 
of this page table, thus pointing to the appropriate page. 
The twelve low-order bits provide a displacement from the 
beginning of the page, thus completing the translation of 
virtual address to real address. 

If the page is found not to be in core, as indi- 
cated in its PAGETABLE entry, the entry for that page is 
found in the SWPTABLE. If the page is not already in 
transit, CP/6/ proceeds Co: bring mt anto cove.) Firss 
the CORETABLE is examined to select a page to be removed. 


Simply stated, CP/67's page replacement algorithm will 
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select, a page for removal if it has not been used or 
if the user associated with that page is not in Q, or 
Q., of the scheduler. LOCKed or in-transit pages are 
exenpe. 

When a page has been selected to be removed, 
its PAGETABLE entry is marked not-in-core and, if 
necessary, it is swapped back into its DASD storage > 
location. The PAGETABLE entry of the missing page is 
then given this real address and marked not-in-core. 
The corresponding CORETABLE and SWPTABLE entries are 
marked in-transit, and a read operation is initiated 
for the missing page. The user is put in PAGEWAIT and 
control returns to the job scheduler (DISPATCH). 

If the page was originally found to be in 
transit, the user is simply put in PAGEWAIT and control 
TetuEnedscOsD LSPATCH. 

When the page has been successfully read in, 
CP/67 removes the user from PAGEWAIT and adds a control 
program execution request block (CPEXBLOK) to the users 
CPRQUEST queue (in UTABLE). The next time DISPATCH 
examines these queues the CPEXBLOK will be executed. 
The page will thus be marked in-core and not-in-transit, 


thereby completing the paging operation. 
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Jee Verte 0 


When a user signs on, CP/67 examines his virtual 
machine configuration and creates the required virtual 
I/O blocks. For each multiplexor device, a new virtual 
multiplexor device block (MVDEBLOK) is created. aie is 
chained to the previous MVDEBLOK and to a corresponding 
real multiplexor Aevice block (MRDEBLOK). The address 
of the first MVDEBLOK is entered into the UTABLE. 

For devices attached to selector channels, the 
list of virtual channel blocks is scanned for the 
channel address. If the channel address is not found, 
Saver cla wechanic lp lLock (VCHEBDOK), a Virtual control 
UnLesD lock (VCUBLOK)*, and a virtual device block 
(VDEVBLOK) are mreated. The address of theifirst 
VCHBLOK is entered in the UTABLE. If the channel 
address is found, the chain of VCUBLOK's is scanned 
POmetiesViEtual COoneroOl Unit address. If not ‘found, 

a VCUBLOK and a VDEVBLOK are created. The address of 
the first VCUBLOK is entered into the VCHBLOK. If the 
control unit address is found, only a VDEVBLOK need be 
created. The address of the first VDEVBLOK is entered 
in the VCUBLOK. Each VDEVBLOK is also chained to its 
corresponding real device block (RDEVBLOK). 

Each channel, control unit, or device block is 
chained to the previous such block. The resulting 
relationship between virtual and real I/O blocks is 


pLinstrated in Fig. A. 2. 
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When a virtual machine issues an I/O command, 
CP/G/ Wie beatakeacopLLOleand, Usindsathe.chains of 
aH £9) blocks, it will translate the virtual I/O command 
into a real I/O command. The user is put in IOWAIT 
and the real I/O is initiated. Control is returned to 
DISPATCH. 

Conversely, when a real I/O interrupt occurs, 
the real interrupt+is translated back into the virtual 
I/O blocks of the user for which it is intended. The 
user is removed from IOWAIT and an interrupt is marked 
PENDING in his UTABLE. The next time DISPATCH examines 
this user, the pending interrupt will be reflected to 
the virtual machine in its channel status word (CSW) 
and its PSW. The next time that user is chosen to run, 


the virtualemachine will®then handle its interrupt. 
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APPENDIX B 


DETAILED DESCRIPTION OF DISPATCH 


Figures. B.1 and B.2 give a detailed flowchart 
MuUbdcehacLOnse Of une Operation Of,DISPATCH. The six 
"cholces, sretew toythe six Criteria by which DISPATCH 
chooses the next user to run. They are described in 
Gnapterwiv (Sec. 4e2-1.2), and are outlined as 
follows: 

tL) RUNUSHER ert —runnabie- 


2) EL roteNEXTUSER SLoundsin O. and” is - runnable; 


i 
Sli cstaNextuUSER found. in Q,-WAIT, and 
runnable; 
4) etirst. NEXTUSER found sin Q,-WAIT, of highest 
DELority, and runneble; 
See cLosteNEXTLUSER found in Qo: CEASSa Oe 
Maghestaprerority, sand, Lunnabie; 
Grbirste=NEXTUSER found in Qor CHAS Smee aor 
highest priority, and runnable. 
It should be noticed that the operation of DISPATCH 


involves two major loops in which each user, in turn, 


Ls examined. 


L SVartual Environment 


The first loop (LOOP1) involves the maintenance 


Ob each user's virtual environment. Note that RUNUSER 
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xS the, first.to.be.examined, and if he is chosen to 
run immediately (Choice 1) examination of the other 
users is preempted. 

LOOP1 first examines the user's CPRQUEST queue. 
Piet Us Genoceetpt yy cic tOp CPEXBLOK is oremovec. and 
control transferred to it. After execution is 
cCOnpleted mCODELOM returns LO DISPATCH. The process 
is repeated until the users CPRQUEST queue is empty. 
LOOP1 then examines the user to see if he is runnable. 
If not runnable, examination of NEXTUSER is begun. 
If runnable, the user is next examined for a pending 
Mrcerrlipt smelt One 1 curOuUnG,; 1c i1ssreflected to the 
virtual machine and the user enters LOOP] again. The 
process is repeated until no pending interrupt is 
found. Examination then begins on the NEXTUSER. 

Each user is charged for the TIMEUSED in this 
loop. When all users have been examined, the second 


loop is begun. 
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2 Queue Maintenance 


The second loop in DISPATCH (LOOP2) involves the 
up-to-date maintenance of the user queues (Q) and Q,)- 
Note again that the first user found who is in Q) and 
runnable is given control immediately (Choice 2), and 
further examination of the queues is preempted. 

The management of Q, and Qo, illustrated in 
biG. b.37 Can ber cjescribed as" follows. 

1) A user enters Q, -WAIT (waiting to enter Q,) 
at the beginning of a request from the 
terminal. 

2) A user enters a Oni yae rom Q,-WAIT, provided 
Q, is not already full. When a user enters 
Q, he is given a .4 sec. quantum or time 
Daimatt. 

3) A user enters Q.-WAIT (waiting to enter Q5) 
from either Q, or Q.- 

a) A user will be removed from Q, under two 
conditions; 
1) if he “uses up his 774 secaequantum 
of TIMEUSED in Q,, or 
ii) if he at any time uses a full 50 msec. 
time-slice without an interruption. 
A user entering Q, i Ont Q, starts with top 
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Fig. B.3 Queue Management 
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b) A user will be removed from Q5 when he uses 
up his 5 sec. quantum in Q.- 

4) A user enters Q5 only on the condition that 
it is not already full. A user leaving Qo: 
CLASS 1 or 2, has his priority lowered each 
time. 

a) A user enters CLASS 1 only from Q,-WAIT. 
He leaves CLASS 1 under the following 
Ewo scondrivons: 

i) if he uses up his 5 sec. quantum, 
in which case he enters Q,-WAIT 
again ;2 OG 

aa write hewatavany time uses a fuil 50 msec. 
time-slice uninterrupted, in which 
case his NOQUANT is incremented by 
one and he automatically enters 
CLASS» 24 

DIAS isergentens “CLASS 27 only from CLASS 1, 
A user leaves CLASS 2 when he uses up his 
5 sec. quantum. When he enters CLASS 2, 
a user retains the priority with which he 


just left CLASS 1. 


The priority scheme within Q, LS -OL.e) .pubbiey 


nature. When a user's priority is lowered, it is made 


the lowest priority in Q5 (rather than lowering it by 
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one notch). Hence all other users in Q5 are effectively 
raised in priority. "thie is’ to prevent a long job from 
workingistse kt eso deep LALO Q5 that .it may never escape. 

Note in Fig. B.2 that during LOOP2, a wait queue 
is maintained of all users waiting to enter a queue 
(Q) or Qo). Users found waiting are entered into this 
wait queue according to the priority scheme given by 
Choices 3 and 4. 

When LOOP2 is completed (i.e. all queues updated), 
DISPATCH is ready to select the next user to run (Choices 
B=6)theilfano user is,found, in, either the wait queue, 
CLASS 1 queue or CLASS 2 queue, then DISPATCH Woe tc Gi 
GP/67>into the’ wait, state. 

The time used in LOOP2 is charged as OVERHEAD to 
the system. The total time spent in DISPATCH plLusytie 
time spent by CP/67 in handling the interrupt leading 
to DISPATCH's entry is accumulated as CPTIME. A time 
chart of all time charged by DISPATCH is given in 


Chapucr, 1Vprrig. 4.1, 
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APPENDIX C 
THE SIMULATION PROGRAM 


Listing of all programs involved in this. project 
may be obtained from the Department of Computing Science 
bibraryoat thes of A. this-appendix is intended to 
provide the general information needed to operate the 
Simulation program in particular. The appendix and the 
GPSS program are complementary and should be used as 
supplements to each other. 

The overall logic of the simulation program is 
described and illustrated in Chapter V (Fig. 5.2 and 
Deo) Pee LiicamMarnaconcern Of the program is to model the 
logic of DISPATCH. Appendix B gives a detailed descrip- 
EPOneOL DiSGPATCH from iwhich+this portion of the program 


logic is derived. 


1 Model Input 


Input to the model is described in terms of the 
number and type of users. To operate the model, then, 
it is first required to specify: 

a) the number of normal users) (Xl) 

b) the number of interactive users (XZ) 

c) the number of heavy users (x3), 

For each of these three types of users there is defined: 


a) a request size distribution (FN1-3) 
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b) a think time distribution (FN4-6) 


cy an Incerrupe arrival “rate tdistribution’ (EN7-9) . 


Two additional distributions are defined which 
are used by all three types of users to generate the 
interrupts associated with each request. These ry 

a) an interrupt wait distribution (FN10) 

b) a distribution giving the nunber of interrupts 


as a function of the size of the request (FN11). 


These eleven GPSS "functions" (FN) may be used as 
they are presently defined or may be changed to any 
desired distribution. Functions 1 through 10 are used 
in conjunction with the random number generators of GPSS. 
Since there are eight such random number generators, 
these too may be altered to obtain variations in the 


generated input. 


Zoey SteemMenevresentacion 
Three constant values are used to represent the 
time used by.CP/67 in,the operation of the model. As 
described an Chapter Vij Sec. ging, they are: 
a) the time required to handle each interrupt 
b) the time used within DISPATCH which can be 
charged to an individual user (i.e. LOOP1) 
c) the time used within DISPATCH which cannot 


be charged to any individual user (i.e. LOOP2). 


‘uM 


1, bs Labour arta to, nolisy a6 git ak Ae yd beau ons. f 























(O-h44) acttudixttetb omkY Adidd a td 


‘rutsib sex l[avinis Sowrisiak as (9 5.4 fee 


sre enolsedtxtel® fenoidibbs- owt 
we te b: oy? so79 “Ile yd Boag Sze : 
si does d3iw batefoosrs asquaxsing 
tudétieib fimw deprrisdag ns (es , 


*' ro = pak . NS POLV ID {64 judsttwsetB 4 (d 


{| to woeioagt Bs. 46 


joayi" 2B9D sAevels saedT a 
tune sariteb yliaseexq exes yodd, 
™~ : ; in 
cir’ 


.ftoisudivteth bextasb 
fie : pobitax og iaiw neitoautaos nk 
Jtpis 326 etait sonia. 
tedcdio oF Rerscis od vem 003 saat 


: - ~ 
.Jugqai Detstenep 


Loi ap doss qed meseaye:  & 


Si3 3nSseoyqet UI Beau ois esulsev Yasksaneo SsegdT 








oe aoe 1s 4 is ata 


| bao 





ot 


iBaH | 


The figures at present are average values estimated from 
hive data. However these figures are flexible and could 
be changed. For instance, (a) could be made a function 
of the type of interrupt if such information was 
available. 

The operation of the system is also reflected by: 

a) the multiplication factor used to determine 
Ciesnumbersorminverrupts asa Lunction of the 
number of users (V6) 

b) the multiplification factor used to determine 
the~interrupt wait time as a function of the 
number of users (V12). 

Whese factors are currently set at ()*, where N is the 
number of users, but can be altered as desired (see 


drscussion, MeChapter Vij~ Sec, 2.2.2). 


Sa LoPALCH eparamecers 


The following parameters of DISPATCH must be speci- 
fied at the beginning of each run: 

ay timeslice (X85) 

b) Q5 quantum (msec.) (X86) 

Cc) Q1 quantum (msec.) (X87) 

ad) maximum no. of users allowed in Q. (X88) 


e) maximum no. of users allowed in Q, (X89). 
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The final two values which must be specified are: 
a) the warmup time (sec.) (X90) 


bjmwthesrunning time (sec,) (x91). 


Together with the logic of the system, as modeled 
in the program, complete representation of the system 
can be achieved by specifying the above set of distri- 


butions, parameters, etc. 
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